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Abstract.  In  a  maximally  decimated  filter  bank  with  identical  decimation  ratios  for  aU  diannels,  the 
perfect  recxxistructibility  properties  depend  on  the  properties  of  the  pdyphase  martrix.  Various  properties 
and  capabilities  of  the  filter  bank  dep>end  on  the  properties  of  the  pdyphase  matrix  as  well  as  the  nature 
of  its  inverse.  In  this  paper  we  undertake  a  study  of  the  types  of  inverses  and  characterize  them  aocwding 
to  their  system  theoretic  properties  (i.e.,  properties  of  state-space  descriptions,  McMillan  degree,  degree  of 
determinant,  and  so  forth).  We  find  in  particular  that  causal  polyphase  matrices  with  anticausal  inverses  have 
an  impcvtant  role  in  filter  bank  theory.  We  study  thar  properties  both  for  the  FIR  and  IIR  cases.  Techniques 
for  implementing  anticausal  IIR  inverses  based  on  state  space  descriptions  are  outlined.  It  is  found  that  causal 
FIR  matrices  with  anticausal  FIR  inverses  (abbreviated  cafacaft)  have  a  key  role  in  the  diaracterization  of 
FIR  filter  banks.  In  a  companion  paper  [1]  these  results  are  applied  for  the  factorization  of  biorthonormal 
FIR  filter  banks,  and  a  generalization  of  the  lapped  (ffthogonal  transform  called  the  biorthonormal  lapped 
transform  {BOLT)  developed. 
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1.  INTRODUCTION 


The  M-cfaannel  maximally  decimated  analysis/^ynthesis  system  of  Fig.  1.1(a)  has  been  studied  exten¬ 
sively  and  iised  in  a  number  of  applications.  Extensive  references  can  be  found  in  (2]-[ll].  It  is  known 
(e.g.,  see  pp.  230-234  of  [8])  that  this  can  be  redrawn  as  in  Fig.  1.1(b)  where  E(z)  and  R(z)  are  the 
polyphase  matrices  of  the  analysis  and  synthesis  bank  respectively.  This  system  has  the  perfect  reconstruc¬ 
tion  (PR)  property  if,  in  absence  of  the  subband  quantizers  Q,  we  have  z(n)  =  z(n).  This  is  equivalent  to 
the  requirement  R(z)E(z)  =  I,  that  is, 

R(z)  =  E-»(z).  (1.1) 

Thus,  as  is  well-known,  the  perfect  reconstruction  problem  in  an  Af  channel  uniform  filter  bank  is  related 
to  the  invertibility  of  the  polyphase  matrix  E(z).  Several  classes  of  filter  banks  have  been  developed  in  the 
past,  depending  on  the  nature  of  E(z)  and  its  inverse.  For  example,  an  FIR  filter  bank  is  one  where  E(z) 
and  its  inverse  are  FIR.  Further  examples  are: 

1.  FIR  filter  banks  where  the  polyphase  matrix  E(z)  is  a  cascade  of  constant  nonsingular  matrices  separated 
by  delays  (Fig.  1.2).  Here  E(z)  is  causal  and  its  inverse  anticausal  [12],  (13). 

2.  FIR  paraunitary  filter  banks  [6]  where  E(z)  is  unitary  on  the  unit  circle  and  R(e’^)  E^  (e^*^)  (trans¬ 
posed  conjugate).  When  E(z)  is  causal,  it  can  be  expressed  as  the  cascade  in  Fig.  1.2  with  the  matrices 
Ti  constrained  to  be  unitary.  As  in  the  first  case,  if  E(z)  is  causal  then  the  inverse  is  anticausal. 

3.  FIR  filter  banks  where  E(z)  cannot  be  expressed  as  the  cascade  shown  in  Fig.  1.2.  An  example  is  the 
second  linear  phase  FIR  PR  system  reported  in  [13],  and  reproduced  in  [8]  (Prob.  7.3).  This  is  an 
example  where  E(z)  is  causal  but  the  inverse  is  neither  causal  nor  anticausal. 

4.  HR  formmUary  filter  banks.  In  the  IIR  paraunitary  case,  if  E(z)  is  causal  and  stable  then  its  inverse  has 
to  be  anticausal  in  order  to  be  stable.  For  some  special  cases,  techniques  to  implement  such  anticausal 
inverses  with  finite  latency  have  been  discussed  before  [14]-[18]. 

5.  Causal  IIR  filter  banks  where  the  analysis  and  synthesis  filters  are  both  causal  and  stable,  which  permit 
a  delay  between  the  input  and  output  [19]. 

Maximally  decimated  paraunitary  filter  banks  are  also  orthonormal  filter  banks,  whereas  more  generally 
a  maximally  decimated  PR  filter  bank  is  biorthonormai  [11].  The  first  and  third  examples  above  are  not 
orthonormal  but  only  biorthonormai.  The  above  results  have  appeared  in  the  literature  as  specific  instances 
of  PR  systems. 

There  does  not  appear  to  be  any  literature  in  digital  signal  processing  which  gives  a  general  treatment 
of  inverses  of  transfer  matrices,  and  classifies  them  according  to  the  type  of  inverse.  In  this  paper  we  do 
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this,  and  derive  syatem-theoretic  characterizations  for  various  cases,  lb  give  an  example,  we  will  show  that  a 
causal  system  has  an  anticausal  inverse  if  and  only  if  the  80^»lled  nalization  matrix  is  nonsingular  (Theorem 
5.1).  We  also  show  that  a  causal  FIR  system  E(z)  has  an  anticausal  FIR  inverse  if  and  only  if  the  degree 
of  the  determinant  is  equal  to  the  McMillan  degree,  that  is  [det  E(z)]  =  ez~^  where  N  is  the  McMillan 
degree  of  E(z).  Both  of  these  results  will  have  applications:  the  first  one  in  the  stable  implementation  of  an 
anticausal  HR  synthe^  bank  and  the  second  one  in  the  characterization  of  a  new  class  of  FIR  filter  banks 
called  the  biorthonormal  lapped  transform  {BOLT). 

In  our  discussions  causal  transfer  matrices  with  anticausal  inverses,  especially  CAvsal  Fir  systems  with 
AntiCAusal  Fir  Inverses  (abbreviated  as  oafacafi)  will  play  a  crucial  role.  This  is  because  essentially  any  FIR 
biorthonormal  filter  bank  (with  uniform  decimation  ratios)  can  be  covered  with  polyphase  transfer  matrices 
of  this  type  (Sec.  1.1). 

In  a  companion  paper  [1]  we  will  present  applications  of  some  of  these  results,  for  the  case  of  FIR  filter 
banks.  For  example  we  will  consider  the  problem  of  &ctorizing  cafacafi  systems  into  degree^ne  building 
blocks.  In  particular  a  complete  characterization  of  the  biorthonormal  lapped  transform  will  be  presented. 
We  will  show  examples  of  cafacafi  systems  which  cannot  be  factorized  into  degree  one  systems.  We  also 
show  that  any  causal  FIR  system  E(z)  with  an  FIR  inverse  can  always  be  factorized  as  Gc,ai^)Gc,e{i) 
where  Ge,a(2)  >s  causal  FIR  with  anticausal  FIR  inverse,  and  Gc,e(z)  is  causal  FIR  with  causal  FIR  inverse. 
However,  we  will  see  that  while  causal  FIR  systems  with  anticausal  FIR  inverses  can  be  factorized  under 
some  conditions,  unimodular  matrices  often  cannot  be  factorized  into  convenient  degree  one  systems. 

J.  1.  Causa!  L7J  systems  with  anticausal  Inverses 

In  this  pap>er  we  will  discuss  the  theory  of  causal  linear  time  invariant  (LTI)  systems  with  anticausal 
inverses.  It  turns  out  that  these  systems  have  an  important  role  in  maximally  decimated  PR  (i.e.,  biorthonor¬ 
mal)  filter  banks  (both  FIR  and  UR).  In  fact  essentially  all  FIR  PR  systems  can  be  characterized  with  these 
systems.  Fbrthermore,  unlike  arbitrary  FIR  systems  with  FIR  inverses,  the  83r8tem-theoretic  properties  and 
factorizability  of  these  systems  are  more  tractable  and  elegant. 

A  causal  p  x  r  transfer  matrix 

G(z)  =  f;z-”g(n)  (1.2) 

n=0 

is  said  to  have  an  anticausal  inverse  if  there  exists  an  r  x  p  transfer  matrix 

H(2)=  ^  z-’*h(n)  =  f;z"h(-n)  (1.3) 

n=— oo  n=0 

such  that  H(z)G(z)  =  Ir.  Thus  H(z)  is  the  left  inverse  of  G(z).  We  are  mostly  interested  in  the  M  x  M 
case  (i.e.,  p  =  r  —  M)  because  in  maximally  decimated  filter  banks,  the  polyphase  matrix  E(z)  is  M  x  M. 
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Rnr  the  non  maximally  decimated  case,  we  have  p  >  r  with  p  representing  the  number  of  channels  and  r 
the  decimation  ratios.  The  relevance  and  importance  of  causal  systems  with  anticausal  inverses  depends  on 
whether  we  are  considering  the  FIR  or  the  HR  case. 

Relevance  in  the  Case  of  HR  Filter  Banks 

The  idea  of  using  an  anticausal  inverse  in  order  to  implement  stable  HR  filter  banks  is  well-known, 
and  was  first  proposed  in  [14]  for  image  subband  coding  where  the  inputs  have  finite  length.  The  fact  that 
HR  inverses  can  be  implemented  in  an  anticausal  fashion  if  their  state  variables  are  properly  initialized  was 
pointed  out  in  [16].  A  general  theory  of  anticausal  inversion  was  then  presented  in  [18].  The  (somewhat 
counterintuitive)  result  that  such  anticausal  inversion  for  the  HR  case  can  be  performed  even  with  infinitely 
long  input  sequences  was  pointed  out  in  [17].  ^  In  Sec.  3.2  we  will  review  these  ideas  in  the  most  general 
setting  of  a  state  space  formulation. 

Relevance  in  the  Case  of  FIR  Filter  Banks 

In  an  FIR  filter  bank,  the  polyphase  matrices  E(z)  and  R(z)  are  both  FIR.  In  this  case  the  PR  condition 
(1.1)  is  satisfied  if  and  only  if  E(z)  has  the  property 

det  E(z)  «  cz-'  (1.4) 

for  some  c  ^  0  and  integer  J.  An  important  problem  in  this  context  is  the  characterization  or  parameterization 
of  all  FIR  transfer  matrices  E(z)  having  the  above  property.  There  has  been  some  progress  in  the  past  [20], 
and  there  are  many  FIR  examples  in  the  literature  satisfying  (1.4)  (any  orthonormal  or  biorthonormal  FIR 
PR  system  is  a  valid  example).  However,  the  general  characterization  is  still  an  open  problem. 

Given  an  FIR  PR  filter  bank  with  polyphase  matric^  E(z)  and  R(z)  satisfying  (1.1),  suppose  we  define 
a  new  filter  bank  with  polyphase  matrices  Ei(z)  =  z~'E(z)  and  Rx(z)  =  z'R(z)  where  /  is  an  arbitrary 
integer.  Then  the  system  is  still  FIR  PR,  with  new  FIR  analysis  filters  and  FIR  synthesis 

filters  z'^Fjk(z).  For  large  enough  /,  we  see  that  Ei(z)  is  causal  and  its  inverse  Ri(z)  anticausal.  The  filter 
responses  are  unaffected  except  for  a  delay,  and  this  does  not  affect  important  properties  of  the  filter  bank 
(e.g.,  energy  compaction,  coding  gain,  etc.).  Thus,  we  can  essentially  characterize  all  FIR  PR  filter  banks 
just  by  characterizing  all  causal  FIR  matrices  with  anticausal  FIR  inverses  (abbreviated  cafacafi). 

In  contrast,  the  family  of  causal  FIR  transfer  matrices  with  causal  FIR  inverses  (i.e.,  unimodlar  matrices 
in  z~^)  are  not  very  useful  in  characterizing  the  class  of  all  FIR  PR  filter  banks.  First,  restricting  the 

t  While  it  is  true  that  an  anticausal  HR  filter  G~^(z)  with  infinitely  long  input  is  in  general  unrealizable, 
it  becomes  realizable  if  its  input  is  the  output  of  its  causal  inverse  G(z). 
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pol3^hase  matrix  to  be  unimodular  results  in  a  loss  of  generality;  given  a  causal  FIR  system  with  arbitrary 
FIR  inverse,  we  cannot  in  general  multiply  it  with  a  delay  to  obtain  a  causal  FIR  system  with  a  causal 
FIR  inverse.  F\irthermore,  as  shown  in  Sec.  2.1  of  [1],  unimodular  matrices  cannot  in  general  be  factorized 
into  degree-one  unimodular  building  blocks. 

A  subclass  of  FIR  PR  ^tems  are  FIR  paraunitary  filter  banks  (which  correspond  to  orthonormal 
filter  banks)  where  E(z)  is  unitary  on  the  unit  circle,  and  Et(l/z*)E(z)  =  I  (superscript  dagger  denoting 
transpose  coigugation).  For  these  systems,  complete  bctorizations  and  characterizations  have  been  found. 
See  [8]  for  detailed  discussions.  In  this  case,  the  choice 

R(z)  =  E-Hz)  =  Et(l/z*)  (1.5) 

guarantees  perfection  reconstruction.  Eqn.  (1.5)  shows  that  if  E(z)  is  causal  FIR  the  inverse  is  anticausal 
FIR.  In  terms  of  the  coefficients  of  the  analysis  filters  hk{n)  and  s}rnthesis  filters  /^(n),  (1.5)  is  equivalent 
to  the  conffition  A(n)  =  hfc(-n).  In  the  HR  case  this  implies  that  if  the  analysis  filters  are  causal  and 
stable,  the  synthesis  filters  are  either  anticausal  or  unstable.  In  [16]-[18],  techniques  for  implementing  stable 
anticausal  inverses  are  discussed. 

The  philosophy  in  this  paper  and  the  companion  paper  [1]  is  that  by  studying  the  more  general  class  of 
cafacafi  systems,  of  which  paraunitary  systems  are  special  cases,  we  can  characterize  all  FIR  biorthonormal 
filter  banks  (with  identical  decimation  ratio  ilf  in  all  channels).  Study  of  cafacafi  systems  is  more  tractable 
than  arbitrary  FIR  systems  with  FIR  inverse,  but  at  the  same  time  it  leads  to  very  little  loss  of  generality 
as  we  will  show.  As  stated  above,  paraumtary  systems  are  already  special  cases  of  cafacafi  systems.  One 
outcome  of  the  proposed  theory  is  the  generalization  of  the  lapped  orthogonal  transform  {.LOT)  [21],[22],[3] 
to  the  biorthonormal  case.  This  will  be  called  the  biorthonormal  lapped  transform  {BOLT).  In  [1]  we  will 
present  a  factorization  theorem  that  covers  all  BOLTs,  and  generates  the  LOT  as  a  special  case. 

Main  naults  and  paper  outline 

1.  In  Sec.  2  we  introduce  causal  systems  with  anticausal  inverses.  In  the  FIR  case,  the  implementation  of 
the  anticausal  inverse  is  trivial  as  long  as  we  permit  a  finite  latency  between  the  input  and  the  output 
(in  this  sense  it  is  not  really  anticausal!).  In  Sec.  3  we  show  that  even  in  the  HR  case  anticausal  inverses 
can  be  implemented  using  the  notion  of  state  space  descriptions.  It  is  shown  that  such  inversion  is 
possible  as  long  as  we  initialize  the  state  variable  of  the  inverse  system  properly.  The  result  holds  even 
with  HR  input  signals,  and  can  be  extended  to  time  varying  filter  banks. 

2.  In  Sec.  4  we  study  FIR  systems  with  FIR  inverses  in  terms  of  the  Smith-form  and  Smith-McMillan 
form,  which  are  well-known  tools  in  system  theory. 
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3.  In  Sec.  5  we  study  deeper  the  properties  of  linear  time  invariant  systems  with  anticausal  inverses. 
We  show  that  an  anticausal  inverse  exists  if  and  only  if  the  so-called  realiztUion  matrix  of  a  minimal 
implementation  is  nonsingular  (Theorem  5.1).  We  then  specialize  to  causal  FIR  systems  with  anticausal 
FIR  inverses  {oafacafi  systems),  and  state  the  afacafi  property  in  terms  of  the  Smith-McMillan  form. 
We  finally  show  in  this  section  that  for  a  causal  FIR  system  G(z)  having  an  FIR  inverse,  the  inverse  is 
anticausal  if  and  only  if  the  degree  of  [det  G(z)]  is  equal  to  the  McMillan  degree  of  G(z). 

Notations  and  acronyms 

1.  Bold  faced  quantities  (and  calligraphic  characters  such  as  71, U,  V)  represent  matrices  and  vectors.  The 

notations  A^,A*  and  A^  represent,  respectively,  the  transpose,  conjugate,  and  transpose-coqjugate 
of  A.  The  accent  ‘tilde’  is  defined  as  follows:  H(z)  =  Ht(l/z*);  thus  if  H(z)  =  53„h(n)z“"  then 
H(z)  =  Sn  circle  H(z)  =  Ht(z). 

2.  The  M-fold  decimator  (i.  M)  has  input  output  relation  y{n)  =  x(Mn),  and  for  the  e3q>ander  (t  M)  it 
is  ]/(n)  =  x{n/M)  when  n  =  integer  multiple  of  M,  and  zero  otherwise  [2],  [8], 

3.  An  FIR  filter  bank  is  one  for  which  all  the  analysis  and  synthesis  filters  are  FIR.  Equivalently  the 
matrices  E(z)  and  R(z)  in  Fig.  1.1  are  FIR. 

4.  Causality  and  anticausality.  A  signal  x(n)  is  causal  if  it  is  zero  for  n  <  0  and  anticausal  if  it  is  zero  for 
n  >  0.  In  both  cases  the  signal  could  be  nonzero  for  n  0.  Causal  and  anticausal  LTl  systems  have 
impulse  responses  that  are  causal  and  anticausal  respectively  (see  (1.2)  and  (1.3)).  The  output  y(n)  of 
an  anticausal  system  depends  only  on  the  input  x(m)  for  m  >  n. 

5.  Cafacafi  systems.  The  phrase  CAusal  Fir  system  with  AntiCAusal  Fir  Inverse  arises  many  times  in  this 
paper,  and  will  be  abbreviated  as  cafafaci. 

6.  Order  versus  degree.  The  order  of  a  causal  rational  transfer  xxiatrix  G(z)  is  defined  as  the  largest  power 
of  z~^  in  its  expression,  whereas  the  McMillan  degree  (often  called  just  degree)  is  the  smallest  number  of 
delays  with  which  we  can  implement  the  system.  For  example  if  G(z)  =  g(0)  -I-  z~^g(l)  with  g(l)  0 
then  its  order  —  1  whereas  the  degree  equals  the  rank  of  g(l)  (p.  667  of  [8]).  For  anticausal  systems 
we  define  the  order  and  degree  in  a  similar  way.  For  example,  the  degree  is  the  minimum  niunber  of 
advance  operators  (z  elements)  required  to  implement  the  system. 

7.  The  ideal  time-reversal  operator  TR  (Fig.  1.3(a))  has  the  input  output  relation  y(n)  =  x(—n).  If  we 
sandwich  an  LTI  system  with  transfer  function  H(z)  between  two  TR  operators,  the  result  remains  LTI 
with  transfer  function  II(z~^)  (Fig.  1.3(b)).  So  if  H{z)  is  causal,  the  s}rstem  in  Fig.  1.3(b)  is  anticausal. 

Z  CAUSAL  LV  SYSTEMS  WITH  ANTICAUSAL  INVERSES 
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An  r-input  p-output  LTI  ^tem  is  characterized  by  a  p  x  r  transfer  matrix  G(z).  It  has  an  inverse  (left 
inverse  to  be  precise)  if  there  exits  H(z)  such  that  H(z)G(z)  —  Ir.Ifp  =  r  then  the  inverse  H(2),  if  it  exists, 
is  unique  in  the  z-domain.  However,  the  inverse  z-transform  of  H(z)  may  still  not  be  unique. 

Consider  the  scalar  example  G(z)  —  1  —  az~^.  The  inverse  is  H(z)  =  1/(1  —  az~^),  and  has  the 
causal  impulse  response  h(n)  s  o"l(n)  (where  l(n)  is  the  imit  step)  or  the  anticausal  impulse  response 
h(n)  =  — a"l(— n  —  1)  depending  on  the  re^n  of  convergence  chosen  for  the  z-transform  [23].  Thus  an 
anticausal  inverse  exists  in  this  case,  even  though  there  also  exists  a  causal  inverse.  Unless  a  =  0  only  one 
of  these  inverses  is  stable. 

In  the  above  scalar  example,  the  system  G(z)  is  FIR  and  the  inverse  is  HR.  In  the  matrix  case,  it  is 
possible  to  have  nontrivial  examples  of  FIR  matrices  with  FIR  inverses.  Here  are  three  possible  situations: 

Example  2.1:  Causal  FIR  with  causal  FIR  inverse  (unimodular  matrix  in  z~^); 


^cample  2.2:  Causal  FIR  with  anticausal  FIR  inverse  (cafacafi): 

G(z)  =  0.5[}  j|j+0.5z-i[Y  Jjj,  G-H*)  =  0.5[J  5]+0.5z["j^  _\]  (2.2) 

Example  2.S:  Causal  FIR  with  mixed  FIR  inverse: 

°«=[i  :]--■[?  i] 

(2.3) 

G-W-0.25[J  ;]-0.25.-[;  ;]+0.25r[-‘ 

In  each  case  the  inverse  is  unique  in  the  z  domain  (since  p  =  r  =  2)  as  well  as  in  the  time  domain  (since  the 
inverse  is  FIR),  In  all  the  examples,  G(z)  is  causal  FIR  and  the  inverse  is  FIR. 

Some  known  IIR  anticausal  filter  banks 


There  is  a  class  of  two-channel  HR  filter  banks  called  power  symmetric  filter  banks  (Sec.  5.3  of  [8]). 
Here  the  two  analysis  filters  have  the  form 


where  ao(x)  and  ai(z)  are  stable  aUpass  functions.  If  the  synthesis  filters  are  chosen  as  Fo(z)  =  Hoiz)  and 
Fi{z)  =  ~Hi{z)  then  the  analysis/synthesis  system  is  free  from  aliasing  and  amplitude  distortions,  and 
suffers  only  from  phase  distortion.  An  example  of  Ifo(z)  satisfying  the  above  form  is  a  digital  Butterworth 
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m  elliptic  lowpass  filter  with  specifications  satis^ring  the  power  symmetric  condition  (p.  211  of  [8]).  Fig. 
2.1(a)  shows  the  polyphase  implementation  of  this  system. 

It  was  proposed  in  [14]  that  if  the  synthesis  bank  is  chosen  as  in  Fig.  2.1(b),  that  is,  the  synthesis  filters 
are  chosen  as 

Foiz)=aoiz^)  +  2ai(z'^),  Fi{z)  =  aoiz^)  -  zai{z^),  (2.5) 

then  the  system  will  have  perfect  reconstruction,  i.e.,  the  phase  distortion  mentioned  above  will  also  be 
eliminated.  This  follows  from  the  fact  that  an  allpass  fimction  at(z)  satisfies  ai(z)a{(z)  =  1.  But  if  ai(z) 
are  causal  stable  allpass  filters  they  have  poles  inside  the  unit  circle  and  zeros  outside.  So  ai(z)  has  all 
poles  outside  the  unit  circle  making  them  unstable  unless  the  filters  are  implemented  in  an  anticausal 
manner.  It  was  shown  in  [16]  that  such  an  anticausal  synthesis  bank  can  indeed  be  implemented  provided 
we  appropriately  transmit  the  state  variables  of  the  filter  realizations  in  the  analysis  bank.  In  Sec.  3  we  will 
present  this  in  a  more  general  context  for  arbitrary  linear  systems  using  the  state  space  formulation. 

3L  IMPLEMENTATION  OF  ANTICAUSAL  INVERSES 

Consider  an  Af-input  M-output  causal  system  with  M  x  M  transfer  matrix  G(z),  and  let  the  state 
space  description  of  a  minimal  implementation  be 


It 


so  that  G(z)  =  D  +  C(zl  -  A)~'B.  We  will  assume  that  [det  G(z)]  0  so  that  a  unique  inverse  G~^(z) 

exists.  If  this  has  an  anticausal  inverse  z-transform,  then  we  say  that  an  anticausal  inverse  of  G(z)  exists. 
In  general  this  is  not  guaranteed  (even  if  [det  G(z)]  ^  0).  Fbr  example,  ^  has  the  unique  causal 

X 

p  m 

inverse  H(z)  =  there  does  not  exist  an  anticausal  inverse.  In  Sec.  5.1  and  5.2  we  provide 

necessary  and  sufficient  conditions  for  the  existence  of  anticausal  inverses. 


S.  1.  Finding  and  Implementing  an  anticausal  Inverse 

The  matrix  Ti  in  (3.1)  is  said  to  be  the  realization  matrix  of  the  implementation.  If  this  is  nonsingular, 
we  can  find  an  anticausal  inverse,  as  we  now  show.  ^  For  this  consider  the  causal  system  described  by 


where 


’3c(n  +  l)]_rA  B]  rx(n)' 
y(n)  J  [c  Dj  [u(n) 

1*  11  •  (S  SI"-" 


t  We  will  show  later  (Theorem  5.1)  that  if  is  singular,  then  an  anticausal  inverse  will  not  even  exist. 
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The  input  and  output  of  this  system  are  denoted  u(n)  and  y(n)  respectively,  to  dif^ingii^h  thAfn  from  (3.1). 
To  find  its  transfer  function  in  terms  of  (A.B.C.D),  note  that  if  we  premultiply  (3.2)  with  H  and  take 
z-transforms  we  can  eliminate  the  state  vector  x(n)  to  obtmn 

U(z)  =  (c(z-4  -  a)"*B  +  Y(z) 

Si  -  '  V-  — ■  ' 

G(»-*) 

so  that  Y(z)  =  |G(z~^)]“^U(2).  In  other  words,  the  transfer  function  of  the  causal  system  (3.2)  is  given  by 
=  [G(«~^)]  This  has  a  causal  impulse  response  h(-n).  Now  consider  the  scheme  of  Fig.  3.1(a). 
Here,  the  causal  system  (3.2)  is  sandwiched  between  the  time-reversal  (Ti?)  operators.  It  therefore  has  the 
transfer  function  H(z)  =  [6(2)]  indeed  (compare  with  Fig.  1.3(b)),  and  its  anticauaai  impulse  response  is 
h(n).  Fig.  3.1(b)  shows  an  equivalent  representation  of  this  system,  where  we  have  used  zt  inst^  of  2~‘I, 
thereby  eliminating  the  TR  operators.  Finally  Fig.  3.1(c)  shows  the  internal  details  of  the  system  of  Fig. 
3.1(a). 

Tmrufer  function,  poles  and  eigenvalues.  Ftom  Fig.  3.1(b)  we  see  that  the  transfer  function  of  the 
inverse  can  be  written  as 

G-‘(2)*D-hC(2-^I-A)-*B  (3.4) 

which  should  be  compared  with  the  transfer  function  of  (3.1)  which  is  G(2)  =  D  -1-  C(2l  -  A)”*B.  The 
eigenvalues  of  A  are  the  poles  of  G(z)  (31],  (8),  whereas  the  eigenvalues  of  A  are  the  reciprocals  of  the  poles 
of  G“*(2).  If  G“*(2)  is  anticausal  stable,  then  the  poles  are  outside  the  unit  circle  so  that  the  eigenvalues 
of  A  are  inside  the  uiut  circle. 

SJL  Cholc0  of  Initial  condMons 

If  we  apply  an  input  u(n)  to  the  system  (3.1)  under  zero  initial  conditions,  then  the  output  y(n)  is 
possibly  of  infinite  duration  even  if  the  input  might  be  of  finite  duration  (FIR).  In  theory,  if  this  infinite- 
length  output  y(n)  is  “fed”  into  the  system  in  Fig.  3.1(a),  its  output  will  be  u(n).  For,  we  have  shown  the 
transfer  function  of  Fig.  3.1(a)  to  be  the  inverse  of  that  of  (3.1).  In  practice  this  requires  infinite  latency  (or 
infinite  storage)  because  of  the  idealized  time  reversal  operators  operating  on  possibly  infinitely  long  signals. 

In  practice  we  can  reduce  this  latency  to  a  finite  value  by  using  the  side  information  provided  by  the 
state  vector  x(n).  This  is  achieved  by  performing  the  computation  in  blocks.  We  will  explain  the  detsdls  by 
refering  to  the  state  space  equations  (3.1)  and  (3.2).  Suppose  we  start  the  system  (3.1)  with  the  initial  state 
x(0)  and  apply  the  causal  input  u(n),  possibly  of  infinite  duration.  Consider  a  segment  of  L  samples 

u(0),u(l),...,u(L-l)  (3.5) 
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whore  L  is  an  arbitrary  integer.  Denote  the  output  during  this  period  as 


y(0),y(i),-.-,y{l.-i). 


(3.6) 


The  state  vector  x(L)  and  the  above  segment  of  the  output  are  completely  determined  by  the  input  segment 
(3.5)  and  initial  state  x(0).  Based  only  on  the  knowledge  of  x(L)  and  the  above  finite  segment  of  the  output 
we  can  reconstruct  the  input  segment  (3.5)  and  the  initial  state  x(0),  if  71  in  (3.1)  is  nonsingular.  For 
example,  from  the  knowledge  of  x(L)  and  y(L  —  1)  we  can  compute 

1-1 


x(L-l) 
u(L  - 1) 


A 

C 


x(L)  ] 

DJ  [y(L-l)J 


(3.7) 


and  from  the  knowledge  of  x{L  —  1)  and  y(L  —  2)  we  can  then  compute 

1-1 


x(I-2)l_rA 

u(L-2)J~[c  Dj 


xiL-l)] 

y(i-2)J 


(3.8) 


and  so  forth.  More  generally,  if  we  run  the  state  space  equations  (3.2)  by  setting  the  initial  state  to  be 


x(L)  =  x(L), 


(3.9) 


and  the  input  to  be 


uiL  +  k)  =  yiL-l-k),  0<k<L-l 


the  output  for  this  duration  will  be 


y(L  +  fc)  =  u(L  —  1  —  fc),  0  <  fc  <  L  -  1, 


(3.10) 


(3.11) 


and  the  final  state  will  be  x(2L)  =  x(0).  This  is  schematically  shown  in  Fig.  3.2.  Since  y{2L  —  1)  =  u(0)  we 
see  that  the  latency  is  equal  to  2L  —  1. 

Summarizing,  if  we  know  a  finite-duration  segment  of  the  output  y(n)  of  the  system  (3.1),  and  the  state 
variable  x(L)  at  the  end  of  this  duration,  we  can  use  the  above  time-reversed  segment  and  the  state  x{L) 
to  compute  the  corresponding  input  segment  (3.5)  and  the  initial  state  x(0).  We  can  repeat  this  process  for 
the  next  set  of  L  input  samples 

u(L),u(L-H),...,u(2L-l).  (3.12) 

If  the  output  of  (3.1)  in  response  to  the  above  input  and  initial  state  x{L)  is 

y(i),y(L-t-l),...,y(2L-l),  (3.13) 


we  can  recompute  the  input  segment  (3.12)  and  the  initial  state  x{L)  firom  the  output  segment  (3.13)  and 
the  final  state  x(2L). 


This  time-reversed  inversion  process  can  be  repeated  indefinitely  no  matter  how  long  the  input  signal 
is,  simply  hy  working  with  blocks  of  length  L.  In  effect  the  ideal  unrealizable  time  reversal  operator  in  Pig. 
3.1(a)  has  been  replaced  with  (3.11)  which  represents  the  time  reversal  of  a  finite-size  block.  In  order  to 
perform  the  inversion  (i.e.,  compute  the  input  u(n)  &om  the  output  y(n),  the  inversion  process  needs  the 
“side  information”  in  the  form  of  the  state  vectors 

x(L),x(2Z/),x(3£),...  (3.14) 

This  is  the  L-fold  decimated  version  {x(nl>)}  of  the  state  vector  sequence  {x(n)}.  As  the  block  length  L 
gets  smaller,  the  latency  or  delay  in  the  inversion  process  gets  smsdler,  but  the  required  amount  of  “side 
information”  per  unit  time  increases. 

In  subband  coding  practice,  the  subband  signals  y(n)  are  (heavily)  quantized,  and  the  above  inversion 
cannot  reconstruct  u(n)  perfectly  even  if  x(nL)  has  high  precision.  In  fact,  one  can  solve  for  the  best  choice 
of  initializing  state  vectors,  that  minimize  the  mean  square  reconstruction  error  in  presence  of  subband 
quantization  [24].  This  optimal  state  sequence  {xo(nL)}  can  be  transmitted  (instead  of  {x(nL)})  with  high 
precision,  and  used  as  the  side  information  for  signal  reconstruction. 

Ikansmission  of  the  state 

Returning  to  the  scheme  of  Eq.  (3.9)-(3.11),  suppose  we  set  the  initial  state  to  x(L)  =  0  instead  of 
x(i)  =  x(i),  and  apply  the  input  (3.10).  Then  by  linearity  the  final  state  will  be 

x(2L)  =  x(0)  -  A^x(L),  (3.15) 

instead  of  x(2L)  =  x(0).  Thus,  if  x(L)  is  not  transmitted,  we  can  estimate  it  by  computing  x(2L)  as  above 
and  solving  for  x(L).  In  the  context  of  filter  bank  implementation,  this  means  that  there  is  no  need  to 
transmit  the  state  x(L)  because  it  can  be  estimated  &om  the  subband  outputs  (3.6)  provided  x(0)  is  known. 
Usually  x(0)  =  0  so  this  is  not  a  limitation.  However,  this  approach  to  estimating  the  initial  state  at  the 
synthesis  bank  end  (rather  than  transmitting  it)  has  some  limitations. 

First,  in  the  case  of  HR  inputs  where  we  have  to  transmit  the  states  and  outputs  in  blocks,  it  is 
not  appropriate  to  assume  x(0)  =  0  at  the  beginning  of  each  block.  So  the  above  alternative  reduces  to 
transmitting  the  initial  state  rather  than  the  final  state  periodically,  and  this  does  not  save  us  anything. 
Second,  the  above  estimation  of  x(L)  involves  inversion  of  A,  and  fails  if  this  matrix  is  singular.  Finally,  since 
the  subbands  are  usually  quantized  heavily  (i.e.,  (3.6)  are  quantized),  we  get  x(2L)  =  x(0)— A^x(L)-|-  error, 
and  the  estimation  of  x(L)  by  inversion  of  A^  might  further  amplify  this  error.  In  fact,  the  motivation  for 
time  reversed  implementation  of  HR  inverses  came  from  the  fact  that  certain  synthesis  filters  were  stable 
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only  in  the  anticausal  form  [14].  In  these  cases  the  eigenvalues  of  A  are  inside  the  unit  circle  (see  end  of  Sec. 
3.1)  so  that  it  is  not  wise  to  compute  A~^  for  large  L. 

The  best  strategy  therefore  is  to  trasmit  the  side  information  (final  state  at  the  end  of  each  block) 
rather  than  trying  to  estimate  it  from  the  quantized  subbands.  The  increase  of  data  rate  due  to  this  side 
information  is  negligible  when  the  block  length  is  large. 

Generalizations 

1.  The  rectangular  case.  It  can  be  shown  that  the  above  time-reversal  technique  works  for  the  case  of  p  x  r 
transfer  matrices  (as  arises  in  nonmaximally  decimated  filter  banks)  provided  the  matrix  "R.,  which  is 
now  rectangular,  has  a  left  inverse  [25].  Details  are  omitted  here. 

2.  The  time-varying  case.  Recently  there  has  been  some  interest  in  the  design  and  implementation  of 
time  varying  filter  banks  with  the  perfect  reconstruction  property  |25]-(29].  In  this  case  the  pol3q>hase 
matrices  E(z)  and  R(z)  are  replaced  with  time  varying  linear  systems.  The  state  space  equations  (3.1) 
and  (3.2)  are  accordingly  time  varying,  that  is  (A,B,C,D)  are  replaced  with  A(n),  B(n),  C(n)  and 
D(n),  and  the  realization  matrix  becomes  a  function  of  time,  Tl{n).  If  72(n)  is  nonsingular  for  each  n, 
then  the  time-reversed  inversion  process  described  previously  continues  to  work  with  slight  change  of 
notations. 

4.  FIR  SYSTEMS  Wrm  FIR  INVERSES 

We  now  state  some  preliminary  results  for  causal  FIR  transfer  matrices  with  FIR  inverses,  paving  the 
way  for  more  results  in  the  following  sections.  In  all  discussions,  “causal  FIR”  is  equivalent  to  “polynomial 
in  z~^”  and  “anticausal  FIR”  is  equivalent  to  “polynomial  in  z.” 

Unimodular  matrices.  A  unimodular  matrix  U(z)  in  z  is  a  polynomial  matrix  in  z,  with  the  property 
[det  U(z)]  =  nonzero  constant  [30],[31],[8].  Note  that 

1.  U~^(z)  exists  and  is  also  unimodular  in  z.  So  U(z)  is  anticausal  FIR  with  anticausal  FIR  inverse. 

2.  None  of  the  columns  (or  rows)  of  U(z)  has  a  factor  /(z)  other  than  a  constant.  (Otherwise  [det  U(z)] 
would  have  this  factor,  which  is  not  possible.) 

3.  We  can  write  U(z)  =  u(0)  -i-  zu(l)  +  z^u(2) . . .  Note  that  U(0)  =  u(0)  so  [det  u(0)]  =  [det  U(0)]  9^  0, 
that  is  u(0)  is  nonsingular.  In  particular,  therefore,  u(0)  9^  0. 

4.  A  unimodular  matrix  in  z~^  is  a  polynomial  matrix  in  z~^  with  the  above  properties.  It  is  a  causal  FIR 
system  with  a  causal  FIR  inverse.  For  an  example,  see  beginning  of  Sec.  2. 

For  the  rest  of  this  section  G(z)  is  a  p  x  r  matrix  with  normal  rank  r  (i.e.,  there  is  some  z  for  which  the 
rank  is  r).  Note  that  G(z)  has  r  inputs  and  p  outputs.  In  maximally  decimated  filter  banks,  the  polyphase 
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matrices  satisfy  p  =  r,  but  we  allow  p  ^  r  to  permit  non  maximally  decimated  systems  (p  >  r).  Such  systems 
also  find  applications  in  the  theory  of  convolutional  codes  [32].  Unless  mentioned  otherwise,  ‘inverse’  stands 
for  left  inverse.  Thus  H(z)  is  an  inverse  if  H(z)G(z)  =  Ir- 

4L 1.  Thm  SmMt-fom  and  the  SmIth-McMIllan  form  [33J[30], 131118] 

Given  a  p  x  r  polynomial  matrix  P(z)  in  the  variable  x,  it  can  always  be  expressed  in  the  form  P(x)  = 
U(x)r(x)W(x)  where  (i)  U(x)  and  W(x)  are  unimodular  in  x  and  (ii)  r(x)  is  ap  x  r  diagonal  matrix  with 
the  first  p  diagonal  elements  'Yi(x),  0  <  t  <  p—  1  that  are  polynomials  in  x.  (This  is  the  Smith  decomposition, 
known  for  over  hundred  years  [33]).  Here  p  is  the  normal  rank  of  P(x).  The  remaining  diagonal  elements 
of  r(x)  are  zero.  The  polynomials  7i(x)  can  always  be  assumed  to  be  monic  (i.e.,  highest  power  of  x  has 
coefficient  unity)  and  furthermore  7i(x)|7j+i(x),  that  is,  7i(x)  is  a  factor  of  7i+i(x).  Such  a  matrix  r(x)  is 
said  to  be  the  Smith-form  of  P(x),  and  is  unique  (but  U(x)  and  W(x)  are  not).  In  this  paper  we  will  have 
occasions  to  use  the  Smith-form  of  polynomials  in  z  (anticausal  FIR  systems)  as  well  as  polynomials  in 
(causal  FIR). 

The  Smith-McMillan  form,  which  derives  firom  the  Smith-form,  is  defined  only  for  C8«isal  rational  sys¬ 
tems.  Thus  let  G(z)  be  a  p  x  r  matrix  of  rational  functions  (ratios  of  polynomials  in  z  or  z~^)  representing 
a  causal  system.  We  first  write  G(z)  =  Gi(z)/d(z)  where  d{z)  is  a  polynomial  in  z  of  sufficiently  high  order 
that  all  the  elements  of  Gi(z)  are  pol}momials  in  z.  We  then  express  Gi(z)  in  Smith-form  U(z)r(z)W(z) 
(all  quantities  are  polynomials  in  z)  and  then  divide  the  diagonal  elements  of  r(z)  by  <i(z)  to  obtain  the 
form  G(z)  =  U(z)A(z)W(z).  Here  U(z)  and  W(z)  are  unimodular  polynomials  in  z  and  r(z)  is  a  p  x  r 

diagonal  matrix  with  the  first  p  diagonal  elements  A«(z)  =  ai{z)/Pi{z).  In  this  scheme  ai(z)  and  Pi{z)  are 

polynomials  in  z  with  no  common  factors  for  a  given  t,  and  we  have  a{(z)|ai.|.i(z),  and  Pi+i{z)\0i{z).  The 
sum  of  orders  of  all  the  /3i(z)  polynomials  can  be  shown  to  be  equal  to  the  McMillan  degree  of  the  causal 
rational  system  G(z). 

The  Smith  form  and  the  Smith-McMillan  form  are  covered  in  many  references  [30]-[32].  We  will  use 
some  of  the  properties  given  in  these  references.  A  review  can  be  found  in  Sec.  13.5  of  [8]. 

Theorem  4.1.  Let  G(z)  be  p  x  r  causal  FIR  with  normal  rank  r.  Consider  the  Smith  decomposition 
G(z)  =  U(z)r(z)W(z)  where  U(z)  and  W(z)  are  unimodular  in  z~^.  (Since  G(z)  is  causal  FIR,  the  diagonal 
elements  7t(z)  of  r(z)  are  causal  FIR.  Also  7i(z)  ^OforO<t<r  —  1  since  normal  rank  =  r.)  Then 

1.  G(z)  has  an  FIR  inverse  if  and  only  if  7i(z)  =  z""'  and  ti<  >  0  for  0  <  i  <  r  —  1. 

2.  G(z)  has  a  causal  F^R  inverse  if  and  only  if  we  can  write  7i(z)  =  1  for  0  <  t  <  r  —  1.  0 
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Proof  of  Part  1.  Since  p  ^  r  in  general,  the  proof  is  somewhat  tricky.  If  7i(z)  =  we  can  take 
the  inverse  to  be  W“^(z)r“*(z)U”^(z)  where  r~*(z)  is  the  left  inverse  of  the  p  x  r  matrix  r(z)  (obtained 
by  replacing  7i(z)  with  l/7i(z),  and  transposing),  and  we  are  done.  Conversely,  suppose  there  is  an  FIR 
inverse  H(z).  Apply  an  input  X(z)  to  the  system  G(z)  such  that 

■1/70(2)1  ^ 

W(z)X(z)=  °  ,  i.e.,  X(z)  =  ^^^  (4.1) 

.  0 

where  Wo(z)  is  the  0th  column  of  W(z)=W~^(z).  Then  the  output  is 

Y(z)  =  U(z)r(z)W(z)X(z)  =  Uo(z),  (4.2) 

where  Uo(z)  is  the  0th  column  of  U(z).  Unless  70(2)  has  the  form  z~”o,  the  above  input  X(z)  is  UR  [because 
W~^(z)  is  unimodular  and  its  0th  column  Wo(z)  cannot  have  the  common  factor  70(2)].  The  output  Uo(2) 
is  however  FIR  (Fig.  4.1).  Thus  the  FIR  inverse  system  H(z)  produces  UR  output  Wo(z)/7o(z)  in  response 
to  FIR  input  Uo(z),  and  this  a  contradiction.  So  we  conclude  7i(z)  has  the  form  z~'^.  That  >  0  follows 
from  the  fact  that  the  Smith  form  is  also  causal. 

Proof  of  Part  2.  Again,  if  7i(z)  =  1,  then  the  inverse  W“^(z)r“^(z)U~*(z)  is  causal  FIR,  and  we 
are  done.  Consider  the  converse.  We  already  showed  that  if  there  is  an  FIR  inverse  then  7i(z)  *=  z~^, 
with  n{  >  0.  In  the  above  input/output  construction,  the  inverse  system  H(z)  is  such  that  the  input  Uo(z) 
produces  the  output  z’^Wo(z).  But  since  Uo(z)  mid  Wo(z)  are  columns  of  unimodular  matrices  in  z~^, 
they  have  nonzero  constant  coefficients.  Thus  if  rto  >  0,  the  output  of  H(z)  is  noncausal  in  response  to 
a  causal  input  (Fig.  4.2).  Since  this  violates  causality  of  the  inverse  H(z),  we  conclude  no  =  0,  that  is, 
70(2)  =  1.  Similarly  7<(z)  =  1,  for  0  <  »  <  r  -  1.  V  VV 


Theorem  4.2.  Let  G(z)  be  p  x  r  causal  FIR.  Then  G(z)  has  a  causal  FIR  inverse  if  and  only  if  it  is 
a  submatrix  of  a  p  x  p  unimodular  matrix  in  z~^.  0 


Proof.  Let  Ui(z)  be  p  x  p  unimodular  in  z~^  such  that  G(z)  is  the  leftmost  p  x  r  submatrix.  Then 
we  can  write  G(z)  =  Ui(z)  so  that  G~^(z)  =  [Ir  0]U7^(z).  Thus  G(z)  has  a  causal  FIR  inverse. 
Conversely,  suppose  there  is  a  causal  FIR  inverse.  By  Theorem  4.1  (part  2), 

G(z)  =  U(z)  [  J]  W(z)  =  U(z)  j  (4.3) 

where  U(z)  and  W(z)  are  unimodular  in  z~^.  Consider  the  product 


(4.4) 
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This  is  unimodular  in  z~^,  and  its  leftmost  pxr  submatrix  is  indeed  G(z). 


VVV 


4L2  SW9  s/»ae0  npnentatktns 

Consider  a  p  x  r  causal  FIR  system 

G(z)  =  g(0)  +  z-'g(l)  + . . .  +  z-^g(K),  (4.5) 


with  g(K)  0  ao  that  the  order  is  K.  Let  (A,B,C,D)  be  a  minimal  realization  of  this  ^tem.  Then  all 
the  eigenvalues  of  A  (which  are  the  poles  of  the  FIR  system)  are  zero,  and  A^  =  0  where  is  the  degree 
of  the  s}rstem  (i.e.,  A  is  N  x  N).  Evidently  N  >  K.  Since  g(n)  s  CA'*~^B  for  n  >  0,  it  is  immediate  that 
CA^B  =  0.  But  more  is  true.  It  is  shown  in  p.  709  [8]  that  CA^  =  0  and  A^B  =  0. 

In  fact  we  can  prove  the  stronger  result  that  A^  =  0.  For  this  note  that  A^B  =  0  implies 

A^(B  AB  ...A«^-^B1  =  0.  (4.6) 


By  readiabiUty  of  the  minimal  realization  (A,B,C,D),  the  matrix  following  A^  above  has  full  row  rank 
N.  So  it  follows  that  A^  s  0.  This  also  verifies  A^  =  0  since  N  >K. 

In  the  next  section  we  will  see  (in  the  p  =  r  case)  that  if  the  system  G(z)  has  an  anticausal  FIR  inverse, 
then  the  realization  matrix  H  (Eq.  (3.1)]  is  invertible.  Moreover  the  state  transition  matrix  A  of  the  inverse 
has  all  eigenvalues  equal  to  zero,  and  A^  «  0. 

S.  PROPERTIES  OF  SYSTEMS  WITH  ANTICAUSAL  INVERSES 


In  this  section  we  develop  some  properties  of  causal  transfer  matrices  with  anticausal  inverses.  The  first 
pertams  to  the  realization  matrix  Hots  state-space  description  (Theorem  5.1).  The  second  pertains  to  the 
SmithrMcMillan  form  (Theorem  5.2)  and  the  third  to  the  McMillan  degree  (Theorem  5.3).  These  results  are 
useful  in  the  implementation  and  factorizations  [1]  of  such  systems. 


S.f.  Nonslngulartty  of  the  realization  nuMx 


Theorem  5.1.  Existence  of  anticausal  inverse.  Let  (A,B,C,D)  be  the  state  space  description  of  a 
minimal  realization  of  a  causal  S3rstem  with  M  x  M  transfer  matrix  G(z).  Then  G(z)  has  an  anticausal 
inverse  if  and  only  if  the  realization  matrix  H  =  ^  j  is  nonsingular.  0 


Proof.  We  have  already  shown  that  if  71  is  nonsingular,  the  system  of  Fig.  3.1(a)  is  the  anticausal 
inverse  of  G(z)  (even  if  (A,  B,  C,  D)  is  not  minimal).  We  only  have  to  show  that  if  there  exists  an  anticausal 
inverse,  then  77  is  necessarily  nonsingular.  The  proof  uses  the  minimality  (i.e.,  reachability  and  observability) 
of  the  realization  (A,B,  C,D). 
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Let  N  be  the  McMillan  degree  of  G(z).  Suppose  we  start  the  system  (3.1)  at  time  n  s  —N  with  initial 
condition  x(—N)  »  0.  In  view  of  reachability,  we  can  always  find  an  input  sequence 

...  0, 0,  u(-Af).  u(-iyr  + 1), . . . .  U(-1)  (5.1) 

such  that  the  state  vector  x(0)  has  any  value  of  our  choice.  Having  done  this  we  can  still  choose  u(0)  in  any 
manner.  Thus,  we  can  always  arrange  the  vector  ^  ^  anything  of  our  choice.  Now  (3.1)  implies 

(5.2) 


fx(l)l 

.[A  B]rx(0)l 

ly(0)J 

-[C  dJ[u(0)J 

If  is  singular,  we  can  choose  |  to  be  a  nonzero  vector  sudi  that 

fx(l)]_fA  Birx(0)l_f0l 

[y(0)J-[c  Djlu(0)J-[oJ 


(5.3) 


Thus  x(l)  =  0  and  y(0)  =  0.  With  u(n)  =  0  for  n  >  0,  the  values  of  x(n  +  1)  and  y(n)  will  therefore  be 
zero  for  all  n  >  0.  Summarizing,  we  can  find  an  input  sequence 


...  0, 0,  u(-N},  vt(-N  -1- 1), ,  u(-l),  u(0),  0, 0, . . . 
such  that  the  output  has  the  form 

.  •  •  0, 0,  y(-N),  y[-N  + 1), . . .  ,y(-l),  0, 0, . . . 


(5.4) 


(5.5) 


under  zero  initial  conditions  (x(— N)  =  0). 

Now  suppose  there  exists  an  inverse  for  G(z),  with  transfer  function  H(z).  This  inverse  would  produce 
tne  FIR  output  (5.4)  in  response  to  the  FIR  input  (5.5).  So  we  obtain  the  schematic  shown  in  Fig.  5.1. 
This  inverse  H(z)  cannot  therefore  be  anticausal  (see  definition  in  Sec.  1.2),  unless  u(0)  =  0  in  the  above 
construction.  But  if  u(0)  =  0  then  x(0)  ^  0  (otherwise  j  become  zero),  and  (5.3)  implies 

Ax(0)  =  0  and  Cx(0)  =  0.  This  violates  the  PBH  condition  |31],[8]  for  complete  observability,  i.e.,  violates 
minimality.  Summarizing,  if  72  is  singular,  then  there  cannot  exist  an  anticausal  inverse.  V  VV 

Example  5.1.  Consider  G(z)  =  j  j  .  Since  the  unique  inverse  H(z)  =  J  j  ®  causal,  there 

is  no  anticausal  inverse  for  G(z).  This  leads  us  to  conclude  that  the  realization  matrix  72  is  singular.  Indeed, 
the  minimal  realization  of  G(z)  given  by  Fig.  5.2  has  A  =  0,B  =  [1  0] , C  —  [0  1]^  ,D  =  I3  so  that  72 
is  singular. 
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Example  5.2.  Let  6(2)  he  MxM  causal paraunitaiy.  Theu  the inveise is  G(z)  and  is anticausal.  Thus 
causal  paraunitary  systems  always  have  anticausal  inverses  (both  FIR  and  UR  cases).  Tius  »  consistmit 
with  the  &ct  that  the  TZ'-matrix  in  this  case  is  unitary  upto  similarity  [8]. 

Example  5.3.  Let  G{z)  =  g(0)  +  p(l)z~^  + . . .  +  g{N)z~^  (single-input  single-output  FIR).  Thmi  the 
anticausal  inverse  can  be  obtsdned  by  long  division  [23].  This  is  consistent  with  the  &ct  that  the  direct  form 
structure  has  a  nonsingular  realization  matrix  (see,  e.g.,  p.  670  of  [8])  as  long  as  g(N)  ft  0. 

Example  5.4.  Consider  a  causal  UR  filter  with  transfer  function  G(z)  — 
with  pfi  /  0,  ^  0.  This  has  McMillan  degree  =  max{NyD).  It  can  be  shown  that  the  realization  matrix  of 

the  direct-form  structure  is  lusnsingular  if  and  only  itN  >D.  For  example,  if  G(z)  =  (1-f  0.5z“^)/(l-t-0.6z~*) 
then  there  exists  an  anticausal  inverse  (namely  the  anticausal  inverse  z-transform  of  1/G(z)  (23])  whereas  if 
G{z)  =  1/(1  -(-  0.6z~^),  then  there  is  no  anticausal  inverse. 

Further  Observations  on  the  Anticausal  Inverse 

1.  CoTiaeguencea  of  Theorem  5.1.  If  ever  G(z)  has  an  anticausal  inverse,  it  can  be  implemented  as  in  Fig. 
3.1(a)  because  71  is  guaranteed  nonsingular.  No  loss  of  generality  is  therefore  encountered  by  restricting 
ourself  to  the  scheme  of  Fig.  3.1(a).  FWthermore,  if  7^  is  angular,  an  anticausal  inverse  does  not  exist 
an3rway,  and  we  need  not  look  for  an  implementation. 

2.  It  is  well-known  that  the  realization  matrix  71  is  invertible  if  D  and  A  —  BD~^C  are  nonsingular  (or  if 

A  and  D  —  CA'^B  are  nonsingular).  Neither  of  these,  however,  is  a  necessary  condition.  Fbr  example, 
let  A  =  0,B  =  1,C  =  1  and  D  —  0  bo  that  G(z)  *  z“*.  Then  ^’=20]  ^  nonsingular;  the 

anticausal  inverse  is  H{z)  =  z. 

3.  Since  any  two  minimal  realizations  (A,B,C,D)  and  (Ai,Bi,Ci,D)  are  related  by  a  similarity  trans¬ 
formation,  their  realization  matrices  are  related  as 


Hi  H 


so  that  71  is  invertible  if  and  only  if  R,\  is. 

4.  Minimality  of  inverse  realization.  The  minimality  of  (A,  B,  C,  D)  implies  that  the  anticausal  realization 
in  Fig.  3.1(b)  is  also  minimal  (Appendix  A).  In  this  sense,  we  will  say  that  the  anticausal  realization 
in  Fig.  3.1(a)  is  minimal.  The  number  of  delay  and  advance  elements  required  to  implement  the  TR 
operators  are  obviously  infinite  and  are  not  counted. 

5.  Degree  of  the  inverse.  Since  A  ’  ■.  thf*  same  size  as  A,  the  preceding  minimality  result  also  shows  that 
the  degree  of  the  anticausal  inverse  G~^(z)  (in  z)  is  the  same  as  the  degree  of  G(z)  (in  z~^).  It  is 
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i^pekling  to  notice  that  a  similar  result  is  true  tot  M  x  M  causal  systems  with  catual  inverses  also  (p. 
712  of  (81). 

6.  Nontinguiarity  and  minimality.  Let  (A,B,C,D)  be  some  realization  of  a  causal  system.  If  72  is 
nonsingular  and  A  has  all  eigenvalues  equal  to  zero,  then  (A,B,C,D)  is  a  minimal  realization,  lb  see 
this  assume  the  contrary,  say  the  realization  is  not  observable.  Then  there  is  v  0  such  that  Av  =  0 
and  Cv  0  (PBH  test,  [31],  [8]).  This  means  the  vector  j  annihilates  72  violating  nonsingularity. 

7.  Stability.  Stability  of  G(z)  does  not  imply  that  of  the  inverse  system,  in  general.  For  example,  let 
G{z)  si  —  az~*,  which  is  stable  for  any  a.  Then  the  inverse  H{z)  s  1/(1  —  az~^)  has  the  anticausal 
invme  transform  -•a''l(— n  —  1)  [23]  (where  l(n)  is  the  unit  step).  This  inverse  is  stable  if  and  only  if 
|a|  >  1. 

S2.  SnMh-MditUlan  tonn  and  BMI/Ulan  degn0 

We  now  present  some  results  on  the  Smith-McMillan  forms  of  FIR  q'stems  with  FIR  anticausal  inverses. 
This  will  also  reveal  an  interesting  property,  itamely  that  the  McMillan  degree  is  equal  to  the  detenninantal 
degree  in  the  square-matrix  case. 

Theorem  5.2.  Smith-McMUlan  form.  Let  G(z)  be  p  x  r  causal  FIR  with  normal  rank  r.  Let  A(z)  be 
the  Smith-McMillan  form  of  G(z).  That  is  G(z)  ==  U(z)A(z)W(z)  where  U(z)  and  W(z)  are  unimodular 
in  z  and  A((z)  =  ai(z)//3i(z)  where  ai(z),Si(z)  are  polynomials  in  z.  Then 

1.  There  exists  an  FIJI  inverse  H(z)  if  and  only  if  A<(z)  =  z”**,  for  0  <  i  <  r  —  1. 

2.  There  exists  an  anticausal  FIR  inverse  H(z)  if  and  only  if  Ai(z)  =  z~^  with  ft  >  0,  for  0  <  t  <  r  —  1.  0 

Proof.  First  note  that  the  FIR  nature  of  G(z)  implies  Si[7''  =  for  some  integers  n,.  (Just  recall 
how  the  Smith-McMillan  form  is  constructed  by  first  obtaining  the  Smith  form  of  a  polynomial  in  z,  then 
dividing  . . .)  So  A,(z)  =  z'”*  x  (polynomials  in  z).  The  foil  normal  rank  of  G(z)  means  that  none  of  the  r 
diagonal  elements  of  the  p  x  r  matrix  A(z)  is  zero. 

The  proof  for  Part  1  is  similar  to  part  1  of  Theorem  4.1.  We  only  have  to  prove  Part  2.  If  A,-(z)  =:  z~^*, 
ii>0,  then  W“^(z)A~^(z)U~^(z)  is  an  anticausal  FIR  inverse.  (Here  A“^(z)  is  the  r  x  p  matrix  whose 
diagonal  elements  are  1/Aj(z)).  We  only  have  to  prove  that  if  there  is  an  anticausal  inverse  H(z),  then 
fi  >  0.  Assume  the  contrary,  for  example,  let  fo  <  0.  Apply  an  anticausal  input  X(z)  to  the  s}rstem  G(z) 
such  that  W(z)X(z)  =  [1  0  ...  0]^.  (For  this,  just  choose  X(z)  to  be  the  0th  column  of  W~^(z).) 
Then  the  output  is  Y(z)  —  z^Uo(z)  with  K  =  -fo  >  0-  Here  Uo(z)  is  the  0th  column  of  U(z).  So  the  input 
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aod  output  are 


(5.6) 


X(*)  *  . . .  +  z*x(-2)  +  «{-l)  +  x(0) 

Y(z)  =  . . .  +  -  2)  +  -  1)  +  ^^y{~K) 

Since  the  columns  of  unimodular  matrices  cannot  have  constant  term  equal  to  zero,  we  have  x(0)  ^  0  and 
y(-X)^0. 

The  inverse  aystem  H(2)  produces  X(z)  in  response  to  Y(z).  Since  x(0)  ^  0  and  iC  >  0,  this  contradicts 
anticausality  of  H(z)  (Fig.  5.3).  The  conclusion  is  tiuU  it  is  not  possible  to  have  fb  <  0.  Similarly  it  foUows 
that  fi  >  0  for  all  t.  V  V  V 


Theorem  5.3.  McMillan  degree  of  caused  FIR  systems  tuhich  have  anticausal  FIR  inverses.  Let  G(z) 
he  M  X  M  causal  FIR  with  FIR  inverse.  Then  |det  G(z)]  =  cz~^  tot  aozoe  integer  N  >0.  Moreover 

M  <  McMillan  degree  of  G(z)  (5.7) 

with  equality  if  and  only  if  G(z)  has  an  anticausal  FIR  inverse.  0 

Proof.  Consider  the  Smith-McMiUan  form  G(z)  =  U(z)A(z)W(z).  Since  this  has  an  FIR  inverse,  we 
know  from  Theorem  5.2  that  the  diagonal  elements  of  A(z)  are  z~^ .  So  [det  G(z)]  =  cz~^  where  N  = 

On  the  other  hand  the  McMillan  degree  is  ^ti>e 

N  =  ^  ii  <  ^  ti  —  McMillan  degree 

i  t4>0 

Ekom  Theorem  5.2  we  know  that  /<  >  0  for  all  t  if  and  only  if  there  exists  an  anticausal  FIR  inverse.  So  the 
result  follows.  V  VV 

Comments. 

1.  A  generalization  of  Theorem  5.3  for  the  rectangular  case  (p  #  r)  can  be  found  in  Appendix  B. 

2.  It  is  well-known  that  if  G(z)  is  a  causal  MxM  FIR  paraunitary  system  then  its  determinant  is  given  by 
cz~^  where  N  is  the  McMillan  degree  of  G(z).  We  now  see  that  this  same  property  is  what  characterizes 
any  causal  FIR  system  with  anticausal  FIR  inverse.  (Note  that  the  inverse  of  the  paraunitary  system  is 
G(z),  which  is  indeed  anticausal.) 

3.  For  any  causal  system  G(z),  it  is  well-known  that  the  degree  of  [det  G(z)]  cannot  exceed  the  McMillan 
degree  of  [G(z)]  (Sec.  13.8  of  [8]).  According  to  Theorem  5.3,  the  degree  of  [det  G(z)]  has  this  maximum 
value  if  and  only  if  the  inverse  is  anticausd. 

4.  An  example  of  a  system  not  satisfying  the  requirements  of  Theorem  5.3  is  when  G(z)  is  unimodular  in 
z~^.  In  this  case  the  degree  of  the  determinant  is  zero  regardless  of  the  McMillan  degree.  The  inverse 


system  in  this  case  is  causal.  Tliis  is  an  extreme  example  where  the  degree  of  the  determinant  is  the 
smallest  possible,  and  the  inverse  is  entirely  oousoi. 


S.S.  bnptriM  napoMB 

Let  G(z)  *  be  Af  X  Af .  and  let  H(z)  =  ^  anticausal  FIR  invwse. 

Assume  the  orders  A*,  L  >  0  to  avoid  trivialities,  and  let  g(0},  g(A),  h(0),  and  h(L)  be  nonnull  matrices. 
Then  all  of  these  are  singular.  To  see  this,  note  that  the  property  G(z)H(z)  =  I  implies,  among  other  things, 
the  following: 

g(0)h(L)  =  0,  and  g(A)h(0)  =  0,  (5.8) 

so  that  all  the  four  mt^rices  are  singular. 

Now  suppose  that  we  are  given  some  Af  x  Af  causal  FIR  transfer  matrix  G(z)  =  A  >  0, 

with  an  FIR  inverse.  If  g(  A)  is  nonsingular,  then  the  inverse  is  guaranteed  to  be  anticausal!  (This  does  not 
violate  (5.8)  as  h(0)  is  guaranteed  to  be  zero;  see  below.)  To  see  this  define 

F(z)  =  z^G(z)  =  g(A)  +  zg(A  -  1)  + . . .  +  z*^g(0).  (5.9) 

If  g(A)  is  nonsingular,  then  an  anticausal  inverse  F~^(z)  (possibly  DR)  will  exist  (use  Sec.  13.10.1  of  [8], 
with  z“^  replaced  by  *  everywhere).  So  G(z)  has  the  anticausal  inverse  H(z)=z^F~^(z).  Since  F~^(z)  is 
anticausal  and  A  >  0,  this  means  that  h(n)  —  0,  n  <  A. 

The  highest  coefficient  g(A)  and  the  Smith-McMiiian  form 

We  can  draw  further  interesting  conclusions  about  the  coefficient  of  the  highest  power  of  z~^.  Let  G(z) 
be  a  causal  FIR  system  with  FIR  inverse.  Then  the  Smith  McMillan  form  has  diagonal  elements  z~^*  and 
we  can  assume  lo>  l\...  (This  follows  from  the  divisibility  properties  Oi(z)|a<.t.i(z),  and  Pi^i{z)\^{z)). 
Suppose  the  first  s  diagonal  elements  are  equal,  that  ia  K  — =  —  t,-i  >  t,-  Then 

+  ZUI  +  ...)  (wo  +  zwi  +  ... 

pxp  U(i)  pxr  A(»), 

where  the  elements  of  x  are  FIR,  with  all  powers  z~*  satisfying  i  <  A.  Thus  G(z)  =  g(«)2'~'*.  with 

g(A)  =  «o[o*  o]wo. 

Since  Uq  and  wq  are  nonsingular,  the  rank  of  g(A)  is  equal  to  s.  In  particular  g(A)  has  full  rank  (=  r  since 
p  >  r)  if  and  only  if 

(5.10) 


) 


In  view  of  Theorem  5.2,  this  gives  a  second  proof  that  if  gC/C)  has  full  rank  the  FIR  inverse  is  anticausal 
(nnoe  s  iC  >  0  for  all  t). 

We  conclude  this  section  fay  malring  a  related  observation.  Given  any  FIR  system  G(z)  —  g(n)z~", 

we  can  alwiys  obtain  a  direct  form  implementation  with  Kr  delays  (e.g.,  Fig.  13.9-1  in  [8]}  so  that  the  degree 
is  at  most  Kr.  When  g(K)  has  rank  r  it  follows  that  the  d^ree  is  precisely  Kr  (see  Example  13.3.2  in  [8]). 
Urns  whenever  tlw  highest  coefficient  g(K)  has  full  rank  r  the  system  has  McMillan  degree  Kr,  wheth»  the 
inverse  is  FIR  or  not. 

A  CONCLUDING  REMARKS 

The  properties  of  perfect  reconstruction  filter  banks  can  be  conveniently  classified  according  to  the 
nature  of  the  inverse  of  the  polyphase  matrix  E(z).  The  main  aim  of  this  paper  in  this  context  has  been 
to  place  in  evidence  the  system  theoretic  properties  of  transfer  matrices  with  certain  types  of  inverses.  In 
particular,  cases  where  the  inverses  are  causal,  anticausal,  and  FIR,  were  considered  detail.  In  [1],  we  will 
find  further  applications  of  some  of  these  results  for  the  parameterization  and  factorization  of  a  subclass  of 
causal  FIR  systems  with  anticausal  FIR  inverses  {cafacafi  systems).  As  noted  in  Sec.  1.1  such  systems  are 
of  interest  because  they  can  be  used  to  characterize  essentiaUy  all  FIR  PR  filter  banks. 

AppetHltxA.  Minimality  of  anticausal  StversB 

Assuming  that  (A,B,C,D)  is  minimAl  (i.e.,  passes  the  PBH  test  for  reachability  and  observability 
[31], [8])  we  will  verify  that  (A,B,C,D)  defined  in  (3.3)  also  passes  the  PBH  test.  This  can  be  done  by 
contradiction.  Assume,  for  instance,  that  (C,A)  is  not  observable.  Then  there  exists  v  51^  0  such  that 

A  A 

Av  =  Av  and  Cv  =  0.  This  means 


[i  i]W- 

The  matrix  on  the  left,  which  is  Ti~^,  is  nonsingular,  so  that  A  ^  0.  Premultiplying  both  sides  of  (A.1)  by 
“R,  and  simplifying  we  obtain  Av  s  v/A  and  Cv  =  0,  contradicting  the  assumed  observability  of  (C,  A). 


(A.1) 


A/^>sndixB.  GeneralbaMtm  of  Theonm  5.3 


Theorem  B.l.  McMillan  degree  of  a  system  with  anticaasal  inverse.  Let  G(z)  be  p  x  r  causal  FIR, 
with  an  FIR  left-inverse.  Let  N  be  the  degree  of  a  highest-degree  r  x  r  minor.  Then  N  is  the  McMillan 
degree  of  G(z)  if  and  only  if  there  exists  an  anticausal  FIR  inverse.  0 


Note.  The  above  minor  need  not  have  the  form  z~”‘.  Example:  G(z)  = 


1 

0 

1-1- z“^ 


0 

1 

1 
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Proof.  Ftom  part  1  of  Theorem  5.2  we  know  that  the  elements  of  the  Smith-McMillan  form  are  z~^. 
Thus 

McMillan  degree  of  G(s)  =  ^  fi-  (^-1) 

ti>a 

Now  recall  how  the  Smith-McMillan  form  is  derived.  We  first  define  Gi(z),  a  polynomial  in  z,  by  writing 
G(z)  s  z~^Gi(z).  Here  £  is  a  sufficiently  large  positive  integer.  The  Smith  form  of  Gi(z)  is  a  polynomial 
in  z.  Since  Gi(z)  has  an  FIR  inverse,  the  diagonal  elements  of  the  Smith  form  of  G](z)  have  the  fc^m 
2*^*  n*  >  0.  (Similar  to  Theorem  4.1,  part  1).  So  the  Smith-McMillan  form  of  G(z)  has  diagonal  elements 
g-L+m^  so  that 

ti  =  L-rn.  (B.2) 


FVom  the  construction  of  the  Smith  form  of  Gi(z)  we  know  z***  =  Ai+i(z)/At(z)  where  A{(z)  is  the  greatest 
common  divisor  (gcd)  of  all  the  t  x  t  minors  of  Gi(z),  and  Ao  1  [30].  FVom  this,  Ar(z)  .This 

means  that  all  r  x  r  minors  of  Gi(z)  are  of  the  form 

z(^‘  "*)  X  [a(0)  +  a(I)z  +  o(2)z»  (B.3) 

Since  the  gcd  of  all  the  r  x  r  minors  is  z  (s.~) 

,  at  least  one  ot  the  r  x  r  minors  is  such  that  a(0)  ^  0.  The 

r  X  r  minors  of  G(z)  therefore  have  the  form 


X  [a(0)  -4-  o(l)z  +  o(2)z* 


(B.4) 


with  at  least  one  of  them  satisfying  o(0)  ^  0.  Since  G(z}  is  causal  FIR,  Eqn.  (B.4)  is  a  polynomial  in  z~^ 
(i.e.,  the  positive  powers  of  z  eventually  cancel).  The  largest  possible  degree  of  (B.4)  therefore  comes  firom 
those  minors  with  a(0)  0,  and  is  equal  to  Lr  —  Elso  ^  =  -nt)-  Ei=o  Th'"  degree  of 

the  largest-degree  minor  of  G(z)  is  given  hy 

r— 1 

—  McMillan  degree  of  G(z)  [firom  (B.l)]  (■B-5) 

<«o  ri>o 

Equality  holds  if  and  only  if  all  /j  >  0,  that  is,  if  and  only  if  G(z)  has  an  anticausal  inverse  (by  part  2  of 
Theorem  5.2).  V  VV 
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Fig.  1.1  (a)  The  maximally  decimated  filter  bank,  and 
(b)  the  polyphase  representation. 


Fig.  1.2.  A  cascaded  structure  representing  an  FIR 
system  with  (anticausal)  FIR  inverse. 


Hg.  1.3  (a)  The  ideal  time-reversal  operator,  and  (b)  transformation 
of  an  LTI  system  into  another  LTI  system  using  time- 
reversal  operators. 


Fig.  2.1  (a)  A  power-symmetric  analysis/synthesis  system,  and 
(b)  moditied  version  satisfying  perfect  reconstruction. 


Fig.  3.1  (a)  Implementation  of  an  anticausal  inverse  system 
by  use  of  inverted  .^ization  matrix,  (b)  simplified 
schematic,  and  (c)  internal  details  of  the  scheme 
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Fig.  4.1.  (a)  An  FIR  system  with  specific  choice  of  input, 
and  (b)  the  inverse  system. 
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(Noncausal  output) 


Fig.  4.2.  Pertaining  to  the  proof  of  Theorem  4.1. 
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Fig.  5.1.  Pertaining  to  the  proof  of  Theorem  5.1.  The  above 

input-output  pattern  is  inconsistent  with  anticausality. 


Fig.  5.2.  A  minimal  realization  of  the  system  in  Example  5.1. 
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Fig.  5.3.  Pertaining  to  the  proof  of  Theorem  5.2. 
Anticausality  is  violated  if  K  is  positive. 
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Abstract.  In  a  companion  pi4>er  [1],  we  studied  the  system-thewetic  properties  of  discrete  time  transfer 
matrices  in  the  context  of  inversion,  and  classified  them  according  to  the  types  of  inverses  they  bad.  In 
particular,  we  outlined  the  role  of  CAusal  Fir  matriccB  with  AntiCAmal  Fir  inveracM  (abbreviated  eafaeafi) 
in  the  characterizatimi  of  FIR  perfect  reomistruttion  (PR)  filter  banks.  Essentially  all  FIR  PR  filter  banks  can 
be  characterized  by  causal  FIR  polyidiase  matrices  having  anticausal  FIR  inverses.  In  this  paper  we  introduce 
the  most  general  degree-one  cafaoafi  building  block,  and  consider  the  i»oblem  of  facUnrizing  cafacafi  systems 
into  these  building  blocks.  Fhctrorizability  ccmditions  are  developed.  A  special  class  of  cafaoafi  qmtems 
called  the  biorthonormal  lapped  transform  {BOLT)  is  developed,  and  shown  to  be  factorizaUe.  This  is  a 
generalization  of  the  well-known  lapped  orthogtmal  transform  {LOT).  Examples  of  unfectcHrizable  cafaoafi 
systems  are  also  dononstrated.  Finally  it  is  shown  that  any  causal  FIR  matrix  with  FIR  inverse  can  be 
written  as  a  {Mnduct  of  a  factorizable  cafacafi  system  and  a  unimodular  matrix. 
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1.  MTnooucnoN 


In  •  oompankm  p^xr  [1],  we  studied  the  syst^n-theoretic  pn^toties  discrete  time  transfer  matrices 
in  the  context  ot  invernon,  and  classified  them  according  to  the  types  of  inverses  they  had.  In  particular, 
we  outlined  the  rde  of  CAuaal  Fir  matrices  taith  AntiCAuaal  Fir  inverses  (abbreviated  onfaoafi)  in  the 
diaracterization  of  FIR  perfect  reconstruction  filter  banks. 

Briefly,  Fig.  1.1(a)  represents  a  maximally  decimated  filter  bank  with  identical  (fecimatkm  ratios  in 
all  the  channels.  This  can  be  redrawn  in  polyphase  form  as  in  Fig.  1.1(b).  The  systmn  has  the  perfect 
reconstruction  property  (i.e.,  x(n)  »  x(n)  in  abeence  of  subband  quantizers)  if  and  only  if  R(z)  s  E~*(z). 
See  [1]  for  detailed  rderences  on  this  topic.  An  FIR  filter  bank  is  one  where  E(z)  and  R(z)  are  FIR.  In  [1] 
we  argued  that  in  the  FIR  case,  if  we  study  the  cafacofi  class  of  matrices  Ei(2)>  is  sufficient  to  diaracterize 
practically  all  FIR  PR  filter  banks. 

In  contrast,  the  family  of  causal  FIR  transfer  matrices  with  causal  FIR  inverses  (i.e.,  unimodular  matrices 
in  z~^)  are  not  very  useful  in  characterizing  the  class  of  all  FIR  PR  filter  banks.  First,  restricting  the 
polyphase  matrix  to  be  rinimodular  results  in  a  loss  of  generality;  given  a  causal  FIR  tystem  with  arbitrary 
FIR  inverse,  we  caimot  in  general  multiply  it  with  a  delay  x~^  to  obtain  a  causal  FIR  tystem  with  a  causal 
FIR  inverse.  Furthermore,  as  we  will  see  at  the  end  of  Sec.  2.1,  unimodular  matrices  cannot  in  general  be 
fectorized  into  degree-one  unimodular  building  blocks.^  FW  these  reasons  we  will  not  pursue  the  possibility 
of  diaracteriang  FIR  PR  si'stems  in  terms  of  unimodular  matrices  alone.  The  class  of  caface^fi  systems  are 
more  useful  than  unimodular  tytems  for  this  purpose. 

In  this  paper  we  will  use  the  results  of  [1]  to  obtain  certain  fundamental  FIR  building  blocks  with 
FIR  inverses.  These  building  blocks  can  be  considered  to  be  the  biortbonormal  versions  of  the  orthonormal 
(paraunitary)  tystems  reported  earlier  [3]-{5].  We  will  consider  the  fectorization  of  cajacafi  S3rstems  using 
these  building  blocks  and  develop  some  results  in  this  direction.  Fbr  convenience  we  state  firom  [1]  two  of 
the  system-theoretic  results  which  play  a  crucial  role  in  this  paper: 

1.  An  M  X  M  causal  LTI  tystem  G(z)  has  an  anticausal  inverse  if  and  only  if  the  realization  matrix 


of  any  minimal  realization  of  G(z)  is  nonsingular  (Theorem  5.1  of  [1]).  Whether  the  anticausal  inverse 
is  FIR  or  not  is  not  addressed  Ity  this  result. 

t  Even  though  it  is  well-known  [2]  that  unimodular  matrices  can  be  expressed  as  products  of  three  kinds 
of  elementary  matrices,  that  would  not  be  a  useful  parameterization  for  filter  bank  design. 
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2.  Let  G(«)  be  an  M  X  M  causal  FIR  system  with  FIR  inverse.  Then  the  inverse  is  antkausal  FIR  if  and 
only  if  [det  G(s)]  s  cz~^  where  N  ~  McMillan  degree  of  G(z)  (Theormn  5.3  of  [1]). 

Pap0routUn0 

1.  In  Sec.  2  we  present  a  degree-one  building  block  for  cafacafi  systems,  and  derive  amditions  und»  whidi 
arbitrary  cafacafi  sys^ama  can  be  factorized  into  these  building  blocks.  Even  though  the  building  blodc 
is  the  most  general  degree-one  cafacafi  system  (as  we  show  later  in  Sec.  4)  we  will  see  in  Sec.  6  that  it 
cannot  be  used  to  bctorize  arbitrary  cafacafi  systems. 

2.  In  Sec.  3  we  restate  the  factorizability  conditions  in  toms  of  state  space  parameters. 

3.  Using  this  we  show  in  Sec.  4  that  a  subclass  of  matrices  called  the  biorthonormal  lapped  transforms 
(BOLT,  a  generalization  of  the  lapped  orthogonal  transform  LOT  16]-(6]),  can  always  be  foctorized  into 
degree  one  cafacafi  building  blocks. 

4.  In  Sec.  5  we  study  FIR  transfer  matrices  of  the  form  +z~^Z./V^  and  show  that  many  properties  of 

the  inverse  can  be  deduced  from  the  eigenvalues  of  'sAu  (Theorem  5.2).  We  use  this  to  find  necessary  and 
sufficient  conditions  for  any  first  order  FIR  matrix  to  be  a  BOLT.  In  particular,  we  impose  conditions 
on  the  degree-one  factors  derived  in  Sec.  2,  guaranteeing  the  BOLT  property  structurally. 

5.  In  Sec.  6  we  derive  examples  of  cafacafi  systems  that  cannot  be  factorized  into  degree  one  building 
blocks,  and  introduce  degree  two  building  blocks.  It  is  also  shown  that  there  exist  cafacafi  systems 
which  cannot  be  factorized  using  any  combination  of  these  building  blocks. 

6.  However,  in  Sec.  7  we  show  that  aiy  causal  FIR  matrix  with  FIR  inverse  can  be  written  as  a  product 
of  a  factorizabie  cafacafi  system  and  a  unimodular  matrix. 

All  notations  and  acronyms  will  be  exactly  as  in  [1]. 

2.  SYNTHES/S  USING  DEGREE-ONE  BUILDING  BLOCKS 

In  this  section  we  introduce  the  general  degree-one  causal  FIR  buUding  block  of  the  form 

V(z)  =  I  -  uvt  -I-  z-^uvt  (2.1) 

where  u  and  v  are  Af  x  1  vectors,  and  study  its  properties.  In  particular,  its  role  in  the  synthesis  of  FIR 
causal  systems  with  anticausal  FIR  inverses  will  be  studied.  Because  of  the  appearance  of  the  outer  product 
uvt,  the  building  block  is  said  to  be  diadic-haacd.  Fig.  2.1  shows  a  structure  for  this  ^rstem.  Note  that 
V(1)  =  I. 

2.1.  Pir^terUnof  Bte  degne-one  building  Mock 
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Theorem  2.1.  CSoosider  the  MxM  system  V(2)  ==  I— uvt  +  z~*uvt  where  u  and  v  are  M  x  1  vectors 
(so  that  the  degree  —  1  unless  u  or  v  is  zero).  Then  the  following  are  true. 

1.  [det  V(z)]  =  1  +  vtu(z~^  —  1). 

2.  Let  utv  s  1,  so  that  (det  V(2))  =  z~^.  In  this  case,  V~^(z)  =  V(2“*)  =  I  -  uv^  +  zuvt.  That  is,  the 
inverse  is  anticausal  FIR.  If  u  =:  v,  then  V(z)  becomes  the  paraunitary  building  block  known  before  (5). 

3.  Let  utv  =  0,  so  that  [det  V(z)]  =  1  (i.e.,  V(z)  is  unimodular  in  z'^).  In  this  case  V~^(z)  =  I H-  uvt  — 

z~^uvt  which  is  causal  FIR.  0 

Proof.  Let  Xj,  0<i<jlf  —  2be  vectors  orthogonal  to  v.  Then  V(z)X(  =  Xi  so  that  there  are  Af  -  1 
eigenvectors  with  eigenvalue  unity.  Next,  substitution  we  see  that  V(z)u  =  (l  +  vtu(z~^  -  l))u  so  that 
(l  +  vtu(z~^  —  1))  is  an  eigenvalue.  When  vtu  ^  0,  u  is  not  in  the  span  of  {x^}.  So  we  have  found  M 
independent  eigenvectors  including  u,  and  all  but  one  have  eigenvalue  equal  to  unity.  Thus 

det  V(z)  =  1  +  vtu(z-»  -  1).  (2.2) 

When  vtu  =  0  it  can  be  shown  that  there  are  no  eigenvectors  of  V(z)  other  than  the  x,  (or  their  linear 
combinations).  Fbr  this  note  that  V(z)w  s  w  +  (vtw)(z~^  —  l)u  for  any  w.  If  w  is  an  eigenvector,  then 
either  (i)  w  is  aligned  to  u  or  (ii)  vtw  =  0.  Since  vtu  =:  0,  condition  (i)  implies  vtw  =  0  which  is  condition 
(ii)  again.  The  condition  vtw  =  0  means,  of  course,  that  w  is  a  linear  combination  of  Xt’s.  So  all  the 
eigenvectors  are  in  the  span  of  x<’s,  and  the  common  eigenvalue  is  unity.  Thus  [det  V(z)]  s  1.  That  is,  (2.2) 
holds  even  with  vtu  =  0. 

The  stated  forms  of  the  inverses  in  parts  2  and  3  can  be  verified  by  direct  multiplication  of  V(z)  with 
the  claimed  inverse  and  using  utv  s  0  or  1  as  the  case  may  be.  V  VV 

Comments 

1.  For  utv  =  1,  the  following  identity  is  easily  verified: 

I  -  uvt  +  2“^uvt  s=  -  uvt  ^  z~*uvt^ . 

K  times 

2.  Smith-McMUlan  forms.  (Reviewed  in  Sec.  4.1  of  [1]).  Since  utv  =  1  implies  that  V(z)  has  an  anticausal 

[g-l  q1 

Q  j  .  On  the  other 

hand,  utv  =  0  implies  that  V(z)  is  unimodular  in  z~*,  and  the  Smith-McMillan  form  of  V(z)  is  the 
identity  matrix  modified  as  follows:  the  first  diagonal  element  is  replaced  with  z~^  and  the  last  diagonal 
element  replaced  with  z. 

3.  Let  uvt  ^  0  to  avoid  trivialities.  Then  we  can  show  the  following:  V(z)  has  an  (i)  anticausal  inverse 
if  and  only  if  vtu  ^  0,  (ii)  FIR  inverse  if  and  only  if  vtu  =  0  or  1.  These  will  follow  as  special  cases 
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of  a  more  gmaerat  result  (Theorem  5.2).  Thus  the  inverse  is  anticausal  FIR  if  and  only  if  vtu  =  1  and 
ciuisal  FIR  if  and  only  if  v^u  =  0. 

A  related  Unimodular  system 

Consider  the  M  x  M  causal  FIR  system  V(z)  —  1  +  z~^uv^,  where  u  and  v  are  Af  x  1  vectors.  If 
vtu  =  0  it  can  be  verified  that  the  inverse  is  I  —  z'^uvt,  so  that  V(z)  is  unimodular.  A  strong^  result  is 
the  following. 

Lenuna  2.1.  The  system  V(z)  =  I  +  z~^uvt  has  HR  inverse  if  vtu  0,  and  causal  FIR  inverse  when 
vtu  =  0.  So  V(z)  is  iinimodular  if  and  only  if  vtu  =  0.  0 

Proof.  Let  Xj,  1  <  t  <  M  -  1  be  a  set  of  independent  vectors  orthogonal  to  v.  Then  V(z)xj  =  x*.  On 
the  other  hand  V(z)u  =  (1  +  z~^vtu)u.  So 

V(z)[u  P)=[(l  +  z-Mu)u  P], 

where  P  is  Af  X  (Af  —  1)  with  columns  equal  to  X{.  If  vtu  ^  0,  the  vector  u  is  not  in  the  span  of  Xj.  So 
[u  P]  is  nonsingular  and  we  get  [det  V(z)]  =  (1  +  z~^vtu).  This  is  not  a  delay  since  vtu  0.  So  the 
inverse  of  V(z)  is  IIR.  W  V 

More  generally,  let  G(z)  be  any  degreeK>ne  unimodular  matrix  in  z~^.  Since  6(oo)  is  nonsingular,  we 
can  always  write  G(z)  =  (I  +  z“^uvt)D  where  vtu  =  0  and  D  =  G(oo). 

A  degree>two  unfactorizable  unimodular  system.  We  now  show  that  the  unimodular  system 

cannot  be  factorized  into  degree-one  causal  imimodular  systons.  Suppose  we  could,  then 

G(z)  =  (Do  -1-  z~^uovJ)  (Di  +  z"^uiv|) ,  (2.4) 

where  Do  and  Di  are  nonsingular  and  must  be  such  that  DqDi  =  I.  We  can  always  rearrange  this  to  be  of 
the  form  G(z)  =  (I-|-z~^uovt)(I-t-z“^Uivt)  by  redefining  the  vectors  u*  and  Vj.  Comparison  of  coefficients 
of  z~^  in  (2.3)  and  the  product  (I  +  z~^uov|)(I  +  z“^Uiv})  shows  that  we  need  uovj  +  uivj  =  0  so  that 
ui  =  cuo  for  some  scalar  c.  This  implies  v^ui  =  0,  since  VqUo  =  0  for  unimodularity  of  (I  -t-  z~^uovt).  Thus 
the  coefficient  of  z~^  in  (2.4)  is  uo(v|ui)vt  =  0,  and  the  product  (2.4)  can  never  be  equal  to  (2.3). 

Degne  reduction  using  degree-one  building  blocks 

We  are  given  oaM  xM  causal  FIR  matrix  with  anticausal  FIR  inverse  Hm(z): 

K  L 

G„(z)  =  Y,  H„(z)  =  Y  (2-5) 

nsO  nsO 
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ABRume  KtL>  0  and  gm(ii^)  ^  0  and  7^  0  to  avoid  trivialities.  Then  K  is  the  order  of  Gm(2)  and 

L  is  the  OTder  of  Hm(2).  If  the  McMillan  degree  of  Gm(2)  is  m,  then 

IdetG„(z)l  =  cz-"* 


(Theorem  5.3,  [1]).  Suppose  we  wish  to  express  it  as 


G„(z)  =  V„(2)G„_i(z)  (2.6) 

where  Vm(2)  is  a  degree-one  causal  FIR  system  with  aaticausal  FIR  inverse: 

V„(z)  =  I  -  uvt  -I-  z'^uvt,  vtu  =  1.  (2.7) 

See  Fig.  2.2(a).  Rom  Theorem  2.1  we  have  (det  Vm(z))  =  z“^  so  Eqn.  (2.6)  implies  (det  Gm-i(2)]  = 
cz~(m~i).  So  we  know  that  Gm-i(2)  has  McMillan  degree  (m  —  1)  as  bng  as  it  is  also  causal  FIR  with 
anticausal  FIR  inverse  (Theorem  5.3,  (1]}.  If  we  can  do  this  successfully  m  times,  then  the  fin^l  remainder 
Go(z)  is  cafacafi  with  constant  determinant  so  that  it  is  just  a  nonsingular  constant  (Theorem  5.3,  [1]).  This 
would  give  the  cascaded  structure  of  Fig.  2.2(b). 

It  only  remains  to  explore  the  conditions  under  which  we  can  successfully  ensure  that  Gm-i(2)  is 
cajacafi.  Since  V;;i^(z)  =  Vot(2”^)  (Theorem  2.1),  we  can  write 

Gm-i(2)  =  ~  +  2uvt^  ^gm(0)  +  z"^g,„(l)  -f- . . .  -i-  .  (2.8) 

Causality  of  the  rem^der  Gm-i(2)  requires  vtg„(0)  =  0.  Next  consider 

Gmi-I W  =  ^hm(O)  +  2h,„(l)  +  ...  +  z^hmiL)^  -  uv^  -|- z~^uvt^ .  (2.9) 

Anticausality  of  this  qriantity  requires  hm(0)u  =  0.  Summarizing,  the  degree-reduction  procedure  will  suc¬ 
ceed  if  and  only  if  there  exist  vectors  u  cmd  v  such  that 

v^gm(0)  =  0,  h,„(0)u=:0,  vtu  =  l.  (2.10) 

We  know  that  gm(0)  and  lin>(0)  are  singular  (Sec.  5.3,  [1])  and  therefore  there  exist  nonnull  vectors  v  and  u 
satisfying  vtg,„(0)  =  0  and  hm(0)u  =  0.  However  there  is  no  guarantee  that  there  will  exist  u  and  v  which 
are  also  nonorthogonal  (so  that  they  can  be  scaled  to  satisfy  vtu  =  1). 

In  Sec.  6  we  will  see  examples  of  cafacafi  Gm(2)  for  which  (2.10)  cannot  be  satisfied.  In  Sec.  4-5  we 
will  present  some  useful  subclasses  of  cafacafi  systems  for  which  (2.10)  can  be  satisfied  at  every  step  of  the 
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degree  reductioo  process.  Towards  this  goal  it  proves  to  be  conveiuent  to  reformulate  the  condition  (2.10) 
in  terms  of  the  state  space  descriptions  (A,  B,  C,  D)  and  (A,  B,  C,  D) 

3.  STATE  SPACE  FORMULATION  OF FACTOROABIUTY 

In  Sec.  3  of  (1]  we  described  causal  systems  having  anticausal  inverses  in  terms  of  minimal  state  space 
descriptions.  Let  (A,  B,  C,  D)  be  a  minimal  realization  of  Gm(2).  Defining  the  realization  matrix  H  and  its 
inverse 


^  ^  ^ 

we  obtain  the  minimal  realization  (A,B,C,D)  for  the  anticausal  inverse  in  the  sense  defined  in  Sec.  3.1  of 
[1].  (We  have  omitted  a  subscript  m  on  the  matrices  (A,B«  C,  D)  etc.,  for  simplicity).  Note  that  the  inverse 
of  Ti  exists  because  of  the  assumed  existence  of  the  anticausal  inverse  (Theorem  5.1  of  [1]).  We  can  express 

K  L 

G„(z)  =  D  +  5^  z-"CA’‘-'B,  a»(z)  =  G^{z)  =  6  +  53  ^^CA^-^B  (3.2) 

nsi 

In  particular,  therefore,  D  =  gm(0)  and  D  =  hm(0),  so  the  three  conditions  in  (2.10)  are  equivalent  to 

vtD  =  0,  Du  =  0,  vtu=l.  (3.3) 

As  stated  before,  D  and  D  are  singular,  so  the  only  nontrivial  issue  is  to  prove  the  existence  of  u  and  v  such 
that  vtu  =  1. 

In  all  the  results  to  follow,  (A,  B,  C,  D)  and  (A,  B,  C,  D)  are  minimal  realizations  of  Gm(2)  and  G~^ (z) 
respectively,  and  are  related  as  in  (3.1).  Note  that  since  Gm(z)  and  G~^(z)  are  FIR,  all  the  eigenvalues  of 
A  and  A  are  equal  to  zero.  By  explicitly  writing  out  the  four  components  of  the  relation  'R.'Rr^  =  I,  we 
obtain  the  four  equations 

AA  +  BC  =  I,  AB  +  BD  =  0,  CA  +  DC  =  0,  CB  +  DD  =  I  (3.4) 

Similarly,  by  writing  out  'Rr^'R,  =  I,  we  get 

AA  +  BC  =  I,  AB  +  BD  =  0,  CA  +  DC  =  0,  CB  +  DD  =  I  (3.5) 

We  will  find  these  equations  useful  for  future  reference. 

Theorem  3.1.  There  exist  vectors  u  and  v  satisfying  v^D  =  0,  Du  =  0,  and  v^u  =  1  if  and  only  if 
there  exist  vectors  t  and  s  satisfying 

As  =  0,  t^A  =  0,  and  t^^s  =  1.  (3.6) 
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Proof.  Suppose  v^D  =  0  for  some  v.  FYom  (3.4)  we  see  that  this  implies  v^CA  =  0  and  v^CB  =  v^. 
Defining  tt  =  vtc  we  see  that  t^A  =  0.  Similarly  we  can  show  using  (3.4)  that  if  Du  =  0  for  some  u  then 
As  =  0  where  s  =  Bu.  With  the  quantities  t  and  s  defined  in  terms  of  v  and  u  as  above,  we  get 

ttg  =  v^CBu  =  v^u 

using  CB  =  I  —  DD  [from  (3.4)]  and  the  fact  that  vtD  =  0.  Summarizing,  if  there  exist  u  and  v  such  that 
v^D  —  0  and  Du  =  0  then  there  exist  t  and  s  such  that  t^A  =  0,  As  =  0,  and  t^s  =  v^u. 

Second,  suppose  there  exist  vectors  s  and  t  such  that  As  =  0  and  t^A  =  0.  Defining  u  =  Cs  and 
vt  =  ttfi  we  can  show  using  (3.5)  that  Du  =  0  and  v^D  =  0,  and  furthermore  v^u  =  t^g.  Combining 
this  with  the  observation  in  the  preceding  paragraph,  we  can  say  that  there  exist  vectors  u  and  v  satisfying 
vtD  =  0,  Du  =  0,  and  vt  u  =  1  if  and  only  if  there  exist  vectors  t  and  s  satisfying  As  =  0,  it  A  =  0,  and 
tt8  =  l.  VVV 

In  the  above  theorem  we  have  established  a  one  to  one  correspondence  between  the  aimihilators  of  the 
pair  (D,D)  and  the  pair  (A,  A).  So  the  degree  reduction  condition  for  the  cafacafi  factorization  can  be 
reformulated  as  follows: 

Theorem  3.2.  The  degree  reduction  step  for  the  causal  FIR  system  Gm(2)  with  anticausal  FIR  inverse 
G;;;^(z)  will  be  successful  if  and  only  if  there  exist  vectors  t  and  s  satisfying  (3.6),  or  equivalently  vectors  u 
and  V  satisfying  (3.3).  0 


A  different  state-space  condition 


With  Gm(2)  and  Hm(2)  expressed  as  in  (2.5),  we  know  that  h(0)g(K')  =  0  and  h(L)g(0)  =  0  (subscript 
m  on  g(n)  and  h(n)  omitted  for  convenience).  This  shows  that  we  can  satisfy  (2.10)  by  taking  vt  to  be 
any  row  of  h(L)  and  u  to  be  any  column  of  g(iir).  There  will  exist  such  a  choice  which  further  satisfies  the 
condition  vtu  ~  1  as  long  as  h(L)g(K’)  0.  In  this  connection,  the  following  result  is  helpful. 

Theorem  3.3.  Consider  the  M  x  M  system  Gjn{z)  =  anticausal  FIR  inverse 

G“^(z)  =  53^0  (A-,B,C,D)  and  (A,B,C,D)  represent  their  respective  minimal  readizations 

related  in  the  usual  manner,  i.e.,  as  in  (3.1).  Then  h(L)g(Ji')  =  0  if  and  only  if  A^~^A^~^  0.  0 


Proof.  We  know  h(L)  =  CA^~^B  and  g(K')  =  CA*^”^B,  so  that 

h(L)g(Jf)  =  CA^-^BCA^-^B  =  CA^-^A^-^B  -  CA^A^B  (using  (3.5)) 
=  CA*-^A^-*B. 


(3.7) 


The  last  equality  follows  because  the  FIR  property  and  minimality  of  the  realizations  imply  CA  =  0  and 
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A^B  —  0  (Lemma  13.9.1,  [4]).  Now  consider  the  product 


(3.8) 


where  m  is  the  McMillan  degree  of  Gm(2).  By  using  CA^  =  0  and  A^B  =  0  it  follows  that  the  only  nonzero 
element  of  this  matrix  product  is  the  M  x  M  block  matrix  CA^“^A^“*B  (i.e.,  b(L)g(K),  by  (3.7)]  which 
will  appeu  on  the  top  left  comer.  However  by  minimality  we  know  that  P  and  Q  have  full  column-rank 
and  row-rank  respectively  (=  m)  so  that  the  above  product  will  be  zero  if  and  only  if  A^~^A*^“^  =  0.  Thus 
h(L)g(ii')  =  0  if  and  only  if  A^“^A^“'  =0.  V  VV 


4L  FACTORIZATION  OF  THE  BIORTHONORMAL  LAPPED  TRANSFORM  (BOLT) 

The  lapped  orthogonal  transform  {LOT)  was  introduced  in  [7]  and  further  studied  in  [6]  and  [8].  The 
LOT  is  essentially  an  M  channel  maximally  decimated  analysis  bank,  in  which  the  polyphase  matrix  satisfies 
two  properties:  first,  it  is  a  first-order  causal  FIR  system,  that  is, 

G(z)  =  g(0)  +  z-'g(l)  (4.1) 


(i.e.,  E(z)  in  Fig.  1.1(b)  has  the  above  form).  Second,  it  is  paraunitaiy,  that  is, 

G-^z)  =  G(z)  =  gt(0)-l-zgt(l). 

The  inverse,  therefore,  is  anticausal  FIR.  Though  G(z)  is  a  first  order  system  (i.e.,  the  highest  power  of  z~^ 
is  z~^),  its  degree  is  equal  to  the  rank  of  g(l). 

A  generalization  of  this  to  the  biorthonormal  case  would  result  if  we  restrict  G(z)  above  to  be  merely 
FIR  with  an  anticausal  FIR  inverse,  and  remove  the  paraunitaiy  (ortbonormal)  constraint.  The  inverse  is  not 
necessarily  equal  to  G(z)  anymore.  We  will  call  this  ^^stem  the  biortbonormal  lapped  transform  {BOLT). 

By  definition  the  BOLT  is  a  maximally  decimated  analysis  bank  (Fig.  1),  where  the  polyphase  matrix 
E(z)  is  a  first  order  causal  FIR  transfer  matrix  (i.e.,  as  in  (4.1)),  and  has  anticausal  FIR  inverse  G~^(z). 
We  sometimes  say  that  G(z)  is  a  BOLT  matrix.  Clearly  the  lAOT  is  a  special  case  of  the  BOLT.  Unlike 
the  LOT,  the  anticausal  FIR  inverse  of  the  BOLT  could  have  higher  order.  Here  is  an  example: 


■  z-1 

-H-z-i 

0  ] 

z 

-1  +  z  o' 

G(z)  =  0 

1 

0  .  G-\z)  = 

0 

1  0 

-1  +  z-i 

0 

z-‘ 

— z  -1-  z* 

1  -  2z  -1-  Z^  2 
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where  G(z)  has  order  =  1  and  the  FIR  anticausal  inverse  has  order  =  2.  However  the  degree  of  G~*(z)  in  z 
is  still  equal  to  the  degree  of  G(z)  in  z~^  (see  Observation  5  at  the  end  of  Sec.  5.1  in  [1]). 

Let  (A,B,  C,D)  and  (A,BtC,D)  be  minimal  realizations  of  G(z)  and  its  anticausal  FIR  inverse 
G~^(z),  related  as  usual  (i.e.,  E^.  (3.1)).  Thus  g(0)  =  D,  and  g(l)  =  CB.  FVom  the  structure  shown 
in  Fig.  4.1  we  see  that  A  =  0  for  any  minimal  realization  of  G(z).  So  any  vector  s  satisfies  As  =  0.  Next,  all 
the  eigenvalues  of  A  are  zero,  and  there  exists  tt  ^  0  satisfying  t^A  =  0.  Thus,  we  can  always  find  vectors 
t  and  8  satisfying  (3.6).  By  using  Theorem  3.2  we  conclude  that  the  degree  reduction  step  will  succeed. t 
The  reduced  remainder  function  will  continue  to  satisfy  A  =  0  so  that  we  can  repeat  the  degree  reduction. 
We  therefore  have: 

Theorem  4.1.  BOLT  factorization.  Consider  an  M-channel  maximally  decimated  filter  bank  with 
anal}rsLB  bank  polyphase  matrix  G(z)  =  g(0)  +  z~*g(l).  Suppose  this  has  an  FIR  anticausal  inverse.  Then 
we  can  factorize  G(z)  as 

G(z)  =  Vp(z)Vp_x(z) . . .  Vi(z)Go,  (4.3) 

that  is,  as  in  Fig.  4.2  where 

1.  p  is  the  McMillan  degree  of  G(z)  (i.e.,  p  =  the  rank  of  the  M  x  M  matrix  g(l)), 

2.  Vto(*)  =  I  -  Umvl,  +  z~^Umvlt  with  v^Um  =  1,  and 

3.  Go  =  G(l)  and  is  nonsingular.  0 

Comments. 

1.  Conversely,  a  product  of  the  form  (4.3)  represents  a  causal  FIR  system  with  anticausal  FIR  inverse,  but 
it  may  not  be  BOLT.  This  is  because  in  general  the  product  does  not  have  the  form  (4.1)  but  can  have 
higher  terms,  e.g.,  z~^g(2).  In  the  next  section  we  will  show  how  to  further  constrain  the  parameh^  of 
(4.3)  which  will  ensure  that  the  product  is  BOLT. 

2.  If  G(z)  has  real  coefficients  it  can  be  verified  that  the  coefficients  of  Vm(z)  are  also  real. 

The  most  general  degree-one  cafacafi  system.  A  degree  one  ^tem  also  has  order  =  1.  So  a  degree 
one  cafacafi  is  a  BOLT  and  can  be  factorized  as  above,  with  p  =  1.  So  we  can  express  it  in  the  form 

G(z)  =  —  uvt  +  z~*uv^^  Go,  (4.4) 

where  utv  =  1  and  Go  is  nonsingular  (in  fact  Go  =  G(l)).  So  the  above  equation  represents  the  most 
general  degree-one  cafacafi.  The  matrix  Go  has  elements  and  each  of  the  vectors  u  and  v  has  M 

t  Note  that  since  A  =  0,  the  quantity  A^“^A^“^  =  0  in  Theorem  3.3,  and  yet  the  factorization  succeeds. 
This  is  because  A^~^A^~*  0  is  only  a  sufficient  but  not  necessary  condition. 
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elements.  Since  these  elements  are  constrained  by  the  equation  utv  =  1,  the  number  of  depress  of  freedom 
in  the  above  equation  is  equal  to  (2Af  —  1)  + 

Smith-McMUlan  form.  With  p  denoting  the  degree,  it  can  be  shown  that  the  Smith-McMillan  form  of 
6(z)  is  A(z)  ~  ^  I  ■  follows  from  the  fact  that  the  quantities  4  defined  in  Theorem  5.2 

of  [1]  satisfy  0  <  4  <  1- 


A  second  cascaded  realization 

The  M  X  M  building  block  Vm(z)  and  the  factorization  (4.3)  can  be  rewritten  in  a  form  which  makes 
the  cafacafi  f  perty  obvious  by  inspection.  To  obtain  this,  let  Ui,  0  <  i  <  Af  —  2  be  a  set  of  mutually 
orthogonal  vectors,  which  in  turn  are  orthogonal  to  v.  We  see  that  V(z)ut  —  ii(.  (The  subscript  on  V(z)  is 
dropped  for  simplicity.)  We  also  see  that  V(z)u  =  z~*u.  Thus 


V(z)(uo  ui 


...  um-2  u)  =  (iio  Ui  ...  UM-a 

caU  this  T 


(4.5) 


Since  v^u  =  1,  the  vector  u  is  not  in  the  span  of  the  u^'s.  So  the  matrix  T  is  nonsingular  and  we  can  rewrite 
the  above  as 

V(z)  =  t[J  (4.6) 

Thus,  the  general  form  of  the  degreeKine  cafacafi  in  Eq.  (4.4)  can  be  rewritten  as 


where  T  and  S  are  nonsingular  matrices.  So  the  BOLT  factorization  Eq.  (4.3)  can  be  rewritten  as 


G(z)  =  Tp 


I 

0 


To 


(4.8) 


where  Ti  are  nonsingular  matrices.  The  structure  is  shown  in  Fig.  4.3.  The  previoiis  factorization  (4.3)  has 
only  2Mp  +  parameters  which  is  less  than  the  number  of  matrix  elements  M^p  +  in  (4.8).  So  there 
is  some  redundancy  in  the  representation  (4.8),  but  its  advantage  is  that  it  is  explicitly  clear  that  the  inverse 
is  anticausal  FIR. 


5.  MORE  RESULTS  ON  FIRST  ORDER  SYSTEMS  AND  BIORTHONORMAL  LAPPED  TRANSFORMS 

Consider  a  first  order  M  x  M  transfer  matrix  of  the  form 

G(z)  =  g(0)  +  z-'g(l).  (5.1) 


Let  the  McMillan  degree  be  p  (i.e.,  the  rank  of  g(l)  is  p).  Suppose  G(l)  is  nonsingular  (as  is  the  case 
when  there  exists  an  FIR  inverse,  since  the  determinant  would  then  be  a  delay).  We  can  then  rewrite 
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G(z)  s  G(l)F(z)  where  F(l)  »  I.  So  we  can  write 

F(z)  =  I  -  +  Z-*  ^  ^  (5.2) 

MxpfiXU 

with  the  constant  matrices  U  and  vt  having  rank  p.  We  will  now  relate  the  properties  of  the  inverse  F~^(z) 
to  the  properties  of  the  matrices  wA  and  'Au.  Such  a  study  adds  significantly  to  the  understanding  of  the 
biorthonormal  lapped  transform. 

5.1.  ktvmv  th0  ffnt  (Hx/er  system 

The  nature  of  the  inverse  of  (5.2)  depends  largely  on  the  properties  of  the  p  x  p  matrix  V^U  as  shown 
the  results  to  be  developed  below. 

Lemma  5.1.  Consider  the  system  F(z)  =  I  —  U)A  +  z~^UV^  where  U  and  V  ue  M  x  p  with  rank  p 
(so  that  F(z)  has  degree  p).  There  exists  an  anticausal  inverse  for  this  system  if  and  only  if  V^li  (which  is 
p  X  p)  is  nonsingular.  0 

Proof.  Fig.  5.1  shows  an  implementation  of  F(z)  with  p  delays,  i.e.,  a  minimal  implementation.  The 
state  space  description  (A,  B,  C,  D)  for  this  is 

A  =  0,  B  =  vt,  C  =  W,  (5.3) 

The  realization  matrix  “R.  is  then 


p  M 


Recall  from  Theorem  5.1  of  [1]  that  there  exists  an  anticausal  inverse  if  and  only  if  the  above  matrix  is 
nonsingular.  We  will  show  that  this  matrix  is  nonsingular  if  and  only  if  V^U  is  nonsingular.  Suppose 
Tlx  s=  0  for  some  vector  x  =  1  ^  .  Then 

LxaJ 

V^X2  =  0,  and  Wxi  +  X2  =  0.  (5.5) 

Combining  these  two  equations  we  get  V^Uxi  =  0.  If  V^U  is  nonsingular  then  Xi  =»  0  and  so  X2  =  —Uxi  —  0 
from  (5.5).  This  implies  that  if  '7^  =  0  then  x  is  necessarily  0.  So  7^  is  nonsingular. 

On  the  other  band,  if  V^U  is  singular  there  exists  y  #  0  such  that  V^My  =  0.  K  we  now  choose  xi  =  -y 
and  X2  =  Uy,  then  11  is  annihilated  by  x  proving  that  it  is  singular.  So  71^  is  nonsingular  if  and  only  if  V^U 
is  nonsingular.  This  completes  the  proof.  V  VV 
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As  an  example  suppose 


WV^=[l]ll  -1)  (5.6) 

Then  p  =  1  but  V^U  0,  so  there  does  not  exist  an  anticausal  inverse.  As  another  example  suppose 
itself  is  nonsingular  (i.e.,  p  =  M)\  then  V^U  is  nonsingular  and  there  exists  an  anticausal  inverse,  possibly 
IIR.  The  next  theorem  makes  precise  the  conditions  under  which  the  inverses  are  FIR. 

Theorem  5.1.  Consider  the  first  order  system  P(2)  =  I  —  UV^  +  z~^UV^  where  U  and  V  are  Map 
with  rank  p  (so  U)A  has  rank  p  and  F(z)  has  degree  p).  Then  the  inverse  of  F(z)  is 

1.  FIR  if  and  only  if  all  eigenvalues  of  UV^  are  restricted  to  be  0*s  and  I’s. 

2.  FIR  and  anticausal  (i.e.,  F(z)  is  ca/acafi)  if  and  only  if  UV^  has  p  of  its  eigenvalues  equal  to  unity  and 
the  remaining  M  —  p  eigenvalues  equal  to  zero. 

3.  FIR  and  causal  (i.e.,  F(z)  is  unimodular  in  z~^)  if  and  only  if  UV^  has  all  eigenvalues  equal  to  zero.  0 
Conunents. 

1.  Restricting  the  eigenvalues  of  a  matrix  P  to  be  zeros  and  ones  does  not  imply  that  =  P  or  that  it  is 
a  projection  matrix.^  For  example,  the  matrix  in  (5.6)  has  all  eigenvalues  =  0,  but  P^  =  0  P. 

2.  Since  U)A  has  rank  p  it  can  have  at  most  p  nonzero  eigenvalues.  But  it  could  be  fewer,  as  in  the  extreme 
example  of  a  triangular  matrix  with  all  (Uagonal  elements  equal  to  zero.  Another  example  is  (5.6)  which 
has  rank  s  1,  but  all  the  eigenvalues  ate  equal  to  zero. 

Proof  of  Theorem  5.1.  Fkom  the  unitary  triangularization  theorem  [11]  we  can  write  l/iA  =  TAT^ 
where  TT^  =  I,  and  A  is  upper  triangular  with  the  eigenvaules  {Aq,  Ai  . . .  A^i, 0, ...  0}  on  the  diagonals. 
(Since  the  rank  is  p  there  could  be  at  most  p  nonzero  eigenvalues).  We  can  then  express 

F(z)  =  T^I  -  A  +  z-^  A^Tt  (5.7) 

so  that 

I 

det  F(z)  =  n 
<=0 

This  is  of  the  form  ct~^  (which  is  necessary  and  sufficient  for  the  existence  of  an  FIR  inverse)  if  and  only 
if  A{  =  0  or  1  for  eadi  t.  Since  the  degree  of  F(z)  is  p,  the  FIR  inverse  is  anticausal  if  and  only  if  the 
determinant  is  cz~^  (Theorem  5.3,  [1]).  This  will  be  the  case  if  and  only  if  U\A  has  p  eigenvalues  equal  to 
unity  (and,  of  course,  the  remaining  M  —  p  eigenvalues  =  0).  Finally  the  FIR  inverse  is  causal  (i.e.,  F(z)  is 
unimodular)  if  and  only  if  the  determinant  is  a  constant,  that  is  Ai  =  0  for  all  i.  V  W 

t  A  matrix  P  is  said  to  be  a  projection  if  it  is  Hermitian  and  P^  =  P  (p.  75,  [10]). 
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We  can  ooiid>ine  Lemma  5.1  and  Theorem  5.1  and  restate  everything  in  terms  of  rather  than  U)A 
as  follows. 

Theorem  5.2.  Consider  the  system  F(z)  si-  U)A  +  z~^U'\A  where  U  and  V  are  M  x  p  with  rank  p 
(so  UV^  has  rank  p  and  F(z)  has  degree  p).  Then 

1.  F(z}  has  an  anticausal  inverse  if  and  only  if  is  nonsingular. 

2.  The  inverse  of  F(z)  is  FIR  if  and  only  if  all  eigenvalues  of  V^U  are  restricted  to  be  O’s  and  I’s. 

3.  The  inverse  of  F(z)  is  FIR  and  anticausal  (i.e.,  F(z)  is  cafacafi)  if  and  only  if  V^U  has  all  eigenvalues 
equal  to  unity. 

4.  The  inverse  of  F(z)  is  FIR  and  causal  (i.e.,  F(z)  is  unimodular)  if  and  only  if  V^U  has  all  eigenvalues 

equal  to  zero.  0 

Proof.  Part  1  is  a  repetition  of  Lemma  5.1.  Parts  2  and  4  follow  from  Theorem  5.1  by  using  the  fact 
that  every  nonzero  dgenvalue  of  the  matrix  PQ  is  an  eigenvalue  of  QP  (for  any  two  nratrices  P  and  Q  for 
which  PQ  and  QP  are  defined).  Part  3  follows  by  combining  parts  1  and  2;  indeed,  the  nonsingularity  of 
^Au  and  the  condition  that  the  eigenvalues  be  restricted  to  be  ones  and  zeros  is  equivalent  to  the  statement 
that  all  the  eigenvalues  of  are  equal  to  unity.  V  VV 

Example  5.1.  The  cases  where  V^U  =  Ip  and  =  0  give  examples  of  FIR  systems  with  anticausal 
and  causal  FIR  inverses  respectiveley.  We  have 

=  (5,9, 

'  '  [l  +  UV*  -z-^UV^  forV'W  =  0 

as  one  can  verify  direct  multiplication.  Notice  that  if  V^U  =  Ip  then  the  inverse  is  also  of  first  order. 
So  first  order  cafacafi  systems  with  higher  order  inverses  (as  in  (4.2))  are  not  covered  by  the  system  with 
ytZY  =  Ip.  In  Sec.  2.1  we  saw  the  special  case  where  p  =  1  (i.e.,  14  and  V  were  vectors  with  lAt4  =  1  and  0 
respectively). 

Example  5.2.  The  following  example 


satisfies  part  4  of  Theorem  5.2  so  that  F(z)  is  unimodular,  even  though  ^  0. 

Example  5.3.  As  a  special  case  consider  I  —  P  +  z"^P  where  P^  =  P.  With  p  denoting  the  rank  of  P, 
we  can  write  P  =  U)A.  Now  P^  =  P  implies  U\Alt)A  =  loA.  Premultiplying  by  lA  and  poetmultiplying 
with  V  and  using  the  facts  that  lAu  and  V^V  are  nonsingular  we  obtain  "lAu  =  I.  Fh>m  part  3  of  Theorem 
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5.2  we  thmfise  conclude  that  there  exists  an  anticausal  FIR  inverse  for  1  -  P  +  when  P^  =  P.  In 
fact  the  invose  is  I  -  P  +  zP,  as  can  be  verified  by  direct  substitution. 

Example  5.4-  Urmnodvlar  system.  By  a  slight  modification  the  above  theoron  we  can  show  that 
I  +  z~^UV^  is  ununodular  if  and  only  if  lAu  has  all  eigenvalues  equal  to  zero. 

5iZ  G0n0tml  Expntaion  and  Cony9ht0  ParmrmttrteaOon  of  th»  Biorthononnml  iMpp^d  Transfotmt 
(BOLT) 

In  Sec.  4  we  considered  the  biorthonormal  liq>ped  transforms  or  BOLT  systems.  These  are  first  order 
cafacafi  systems,  that  is,  systems  of  the  form  G(z)  =  g(0)+z~^g(l)  with  anticausal  FIR  inverses.  Since  this 
implies  G(l)  is  nonsingular,  we  can  write  G(z)  =  G(l)F(z)  where  F(z)  is  as  in  (5.2).  Using  Theorem  5.2 
(part  3)  we  can  say  that  a  system  G(z)  is  BOLT  if  and  only  if  it  has  the  form  G(z)  =  G(l)  (l— +z~ 
where  V^U  has  all  eigenvalues  equal  to  imity. 

In  Sec.  4  we  showed  that  the  BOLT  can  be  factorized  as  in  (4.3)  where 

Vm(z)  =  I  -  Umvt,  +  Z~‘u,nv]t„  v][jUm  =  1,  (5.10) 


and  p  is  the  degree  of  G(z)  (i.e.,  p  =  rank  of  g(l)).  Conversely,  if  we  have  a  product  of  the  form  (4.3)  with 
Vm(z)  as  above,  it  still  represents  a  system  with  anticausal  FIR  inverse,  but  may  have  order  >  1  (i.e.,  there 
could  be  terms  g(n)z~’*,n  >  1  in  G(z)).  lb  ensure  that  the  product  has  order  —  1  (i.e.,  that  it  represents  a 
BOLT),  we  need  to  impose  further  restrictions  on  us  and  vit.  Suppose  we  restrict  these  vectors  to  be  such 


that 


1  <»<*-!, 
i  =  k 


Then  it  is  easily  verifed  by  induction  that  the  product 


(5.11) 


G(z)  =  G(l)V^(z)V^,(z) . . .  Vj(z), 


(5.12) 


with  V„(z)  defined  as  above  does  reduce  to  the  form 

G(z)  =  G(l)(l  -  +  z- W),  (5.13) 

with  the  constant  matrices  V  and  14  pven  by 

V=(vi  V2  ...  V^),  Z/=(Ui  U2  ...  u^).  (5.14) 


Notice  that  the  constant  matrix  G(l)  occurs  as  the  left-most  factor  unlike  in  (4.3).  This  difference  is 
immaterial;  a  slight  variation  of  the  steps  would  lead  to  the  form  (4.3).  Ebccept  for  this  difference,  the 
structure  for  (5.12)  is  as  in  Fig.  4.2. 


Conversely,  can  we  represent  any  BOLT  system  as  in  (5.12)  with  the  restriction  (5.11)?  The  answer 
is  in  the  affirmative:  If  G(z)  is  BOLT,  this  means  in  particular  that  it  has  an  FIR  inverse,  and  so  G(l)  is 
nonsingular.  So  we  can  always  write  a  degree  p  BOLT  as  in  (5.13),  where  U  and  V  are  M  x  p  matrices  with 
rank  p.  Now  WV^  =  UTT^vt  for  any  unitary  T,  and  we  can  rewrite  =  WiVj  by  defining  U\  =  WT  and 
Vi  =  T^vt.  Note  that  v\u-i  ^  By  proper  chc^  of  T  we  can  ensure  that  is  a  triangular 

matrix.  In  other  words,  we  can  assume  without  loss  of  generality  that  V^U  is  triangular.  Since  G(z)  is 
cafacafi  we  see  that  this  matrix  has  all  diagonal  elements  equal  to  unity  (use  part  3  of  Theorem  5.2),  that  is. 


1 

0 

0 

.0 


X  X 
1  X 
0  1 

0  0 


X' 

X 

X 

1. 


(5.15) 


where  x  stands  for  possibly  nonzero  elements.  Now  denote  the  columns  of  V  and  2/  as  in  (5.14).  Then  the 
property  (5.15)  means  that  (5.11)  is  satisfied. 

Thus  we  have  defined  a  set  of  vectors  Um  and  Vm,  1  <  m  <  p  such  that  they  satisfy  (5.11).  We  already 
mentioned  that  if  such  Um  and  Vm  ore  used  in  the  product  (5.12),  the  result  has  the  form  (5.13)  with  U  and 
V  given  by  (5.14).  In  other  words,  the  given  BOLT  matrix  (5.13)  can  indeed  be  represented  as  in  (5.12), 
with  the  vectors  satisfying  (5.11). 

We  can  summarize  all  of  the  above  results  as  follows. 


Theorem  5.3.  BOLT  Oiaracterization.  Consider  aa  M  x  M  transfer  matrix  G(z).  We  say  that  this 
is  a  BOLT  if  G(z)  =  g(0)  +  z~^g(l),  and  it  has  and  anticausal  FIR  inverse.  The  following  statements  are 
equivalent: 

1.  G(z)  is  a  BOLT. 

2.  G(z)  can  be  factorized  as  G(z)  =  G(l)V^(z)V^i(z)...  Vi(z)  where  G(l)  is  nonsingular  and  Vm(x) 
are  as  in  (5.10),  with  the  vectors  and  Uj  satisfying  (5.11). 

3.  G(z)  can  be  written  in  the  form  G(z)  =  G(1)(I— l/V^  +  z~^2/V^),  where  G(l)  is  nonsingular  and 
has  all  eigenvalues  equal  to  unify. 

4.  G(z)  can  be  written  in  the  form  G(z)  =  G(l)(l— MV^  +  z~^WV^),  where  G(l)  is  nonsingular  and 
has  the  form  (5.15). 

Thus  if  G(z)  is  BOLT  with  V^U  written  in  the  form  (5.15),  the  columns  of  V  and  W  [see  (5.14)]  satisfy 
(5.11),  and  can  be  taken  to  be  the  vectors  Vm  and  Um  in  the  factorization  (5.12).  So  the  factorization  is 
determined  simply  by  identifying  the  columns  of  V  and  U.  0 
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Degna  of  freedom.  Thus  the  BOLT  is  charact^ised  by  (5.12)  whidi  has  a  iKwisingtiiar  noatrix  G(l) 
with  dements,  and  2p  vectws  UA.Vk,  with  M  elonmts  each.  That  is,  th»e  are  +  2pM  scalar 
demmts  associated  with  the  e:q>reeskHi  (5.12).  But  the  number  of  freedoms  is  less  than  this,  in  view  of 
the  constraints  (5.11).  In  the  real  coefficient  case  it  can  be  verified  that  the  M  x  M  degree-p  BOLT  has 

+  2pM  —  0.5p(/>  -f- 1)  degrees  of  freedom.  In  the  special  caae  of  the  LOT  (i.e.,  the  paraunitary  case) 
we  have  s  v*  and  G(l)  is  unitary  so  there  are  only  0.5M(M  -  1)  +  pM  -  0.5p(p  +  1)  degrees  of 
freedom.  IVaditional  transform  coding  (which  is  a  special  case  where  loA  s  0  and  G(l)  is  unitary)  has  only 
0.5M (ilf  —  1)  freedoms.  The  extra  freedom  offered  by  the  BOLT  can  i>erhape  be  exploited  to  (fotdn  better 
attenuation  for  the  analysis  filters  (see  example  below),  or  to  impose  other  constraints  such  as  linear  phase, 
regularity  (for  wavelet  synthesis  (12])  and  so  forth.  This  topic  requires  detailed  investigation,  and  is  b^nd 
the  scope  of  this  paper. 

Design  Example  5.1:  The  BOLT  filter  bank 

We  now  present  a  design  example  for  the  BOLT  filter  banlc.t  Let  M  =  8  [i.e.,  an  eight  channel  filter 
bank,  see  Fig.  l.l(a)].  Let  the  polyphase  matrix  E(z)  =  g(0)  +  z~^g(l)  with  rank  of  g(l)  equal  to  three 
(i.e.,  degree  of  E(z)  is  three).  This  is  constrdned  to  be  a  BOLT  hy  expressing  it  in  the  factored  form  (5.12) 
and  constraining  the  vectors  to  satisfy  (5.11).  Under  these  constraints,  the  magnitude  responses  |£rk(e^‘^)|  of 
the  analysis  filters  are  optimized.  The  result  is  shown  in  Pig.  5.2  (a).  Fbr  comparison.  Fig.  5.2(b)  shows  the 
responses  of  the  corresponding  LOT  filter  bank  (i.e.,  with  the  vectors  further  constrained  such  that  Vi  =  Ui 
for  each  t).  The  improved  filtering  characteristics  of  the  BOLT  over  the  LOT  is  clear  from  the  plots. 

A  DEGREE-TWO  DYADIC  BUILDING  BLOCKS 

If  the  degree-one  reduction  scheme  of  Sec.  2  has  to  work,  there  should  exist  vectors  u  and  v  such 
that  (2.10)  holds.  If  this  is  not  the  case,  one  might  consider  extracting  the  building  block  from  the  right 
rather  than  left,  i.e.,  one  might  try  the  decomposition  Gm(2)  —  6m-i(2)Vm(z)  instead  of  (2.6).  In  this 
case  the  degree  reduction  equations  remain  the  same  except  that  gm(0)  and  hni(0)  are  interchanged.  Thus, 
degree-one  reduction  will  foil  when  neither  of  the  following  two  conditions 

Condition  1:  v^gTO(O)  =  0,  hm(0)u  =  0,  u^v  =  1,  (6.1) 

Condition  2:  vthm(0)  =  0,  gm(0)u:=0,  u^v  =  l  (6.2) 

can  be  satisfied  for  any  choice  of  u  and  v. 

t  We  would  like  to  thank  Yuan-Pei  Lin,  graduate  student,  Caltech,  for  generating  this  example. 
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8.1.  Omm  wtmrn  thgiw-one  rtdueUon  faUs 

We  can  create  examples  of  cafacafi  systems  for  which  degreeKme  reduction  will  fail.  For  example,  let  us 
consider  the  2x2  case  (M  =  2).  In  this  case  we  can  exactly  specify  the  conditions  when  the  degree  reduction 
will  fail. 

Lemma  6.1.  Let  GmC^)  be  2  x  2  cafacafi  with  inverse  Hm(2)  (both  as  in  (2.5)).  Assume  gm(0)  0 

and  hm(0)  #  0  and  /T,  L  >  0  in  (2.5).  Then  the  degree  reduction  by  one  (using  the  building  block  (2.1))  will 
fail  if  and  only  if  gm(0)hm(0)  =  hm(0)gm(0)  =  0,  that  is,  if  and  only  if  DD  =  DD  =  0  in  terms  of  state 
space  notations  (Sec.  3).  0 

Proof.  Since  the  2x2  matrices  gm(0)  and  hm(0)  are  singular  (Sec.  5.3  of  [1])  and  nonzero,  the  vectors 
V  and  u  satisfying  vthm(O)  =  0  and  gm(0)u  =  0  are  unique  up  to  scale.  Clearly  gm(0)  and  hm(0)  have 
rank  one,  and  we  can  write 

gm(0)  =  ab^  and  hm(0)  =  cd^ 

for  some  2x1  non  nuU  vectors  a,b,c  and  d.  Thus  vthm(O)  =  0  and  gm(0)u  =  0  imply,  respectively, 

v^c  =  0  and  b^u  =  0. 

Fkom  this  we  see  that  if  v^u  —  0,  then  u  —  c  and  v  3=  b  (up  to  scale)  and  this  implies  btc  —  vtu  —  0,  that 
>8,  gfn(0)faw(0)  =  0.  So  if  (6.2)  cannot  be  satisfied  then  gm(0)lim(0)  »  0.  Conversely,  let  gnt(0)hm(0)  —  0. 
Then  btc  =  0.  So  the  conditions  vthm(O)  =  0  and  gm(0)u  =  0  imply,  respectively,  v  =  b  and  u  =  c  (up 
to  scale)  so  that  vtu  =  btc  =  0,  and  (6.2)  cannot  be  satisfied.  Thus  (6.2)  cannot  be  satisfied  if  and  only  if 
gm(0)hm(0)  s  0.  Similarly  (6.1)  cannot  be  satisfied  if  and  only  if  hm(0)gm(0)  =  0.  V  VV 

Since  the  cafacafi  system  and  its  inverse  satisfy  the  state  space  relations  (3.4)  and  (3.5),  we  can  restate 
the  above  result  in  terms  of  state  space  parameters  (Sec.  3)  like  this;  the  degree-one  reduction  step  will  fail 
in  the  2x2  case  if  and  only  if 

CB  =  CB  =  I. 

This  follows  by  setting  DD  =  0  in  the  last  equation  of  (3.5)  and  DD  =  0  in  the  last  equation  of  (3.4). 

2x2  Example  where  degree-one  reduction  fails 
Now  consider  the  M  x  M  system 

Gm(z)  =  abt  -I-  z-»I  +  z-^abt,  a+b  =  0.  (6.3) 

where  a  and  b  are  non  zero  M  x  1  vectors.  We  can  verify  that  the  inverse  is  G^^(2)  =  -ab^  -I-  2I  -  ab^z*, 
by  multiplying  the  two  expressions.  This  system  is  therefore  cafacafi.  Since  a^b  =  0,  we  have  gni(0)hm(0)  = 
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lw(0)gm(0)  =  0.  So  by  Lemma  6.1,  the  degree  reduction  step  will  fail  in  the  M  =  2  case.  For  Af  =  2,  the 
system  (6.3)  therefore  serves  as  a  cafacafi  example  where  the  degreeK>ne  reduction  fails,  that  is,  neither  (6.1) 
nor  (6.2)  be  satisfied  for  any  pair  of  vectors  u  and  v. 

In  Appendix  A  we  show  that  for  arbitrary  M  the  degree  of  (6.3)  is  equal  to  M,  and  present  a  minimal 
implementation  (Fig.  A.l). 

M  X  M  example  where  degree-one  reducrtion  fails 

If  Af  >  2,  the  system  in  (6.3)  is  still  cafacafi,  but  its  degree  can  be  reduced  successfully  by  one,  using 
the  building  block  (2.1).  To  see  this  note  that  in  this  case  there  exists  a  vector  w  orthogonal  to  both  a  and 
b  so  that  we  can  set  u  =  v  =  w  and  satisfy  (6.1).  To  create  an  Af  x  Af  example  which  cannot  be  factorized 
into  degree-one  bulling  blocks,  consider 

G(2)  =  PP+  +  ab^  -i-  2-^1  -  PPb  +  ^~^ab^  (6.4) 

where  P  is  Af  x  (Af  —  2),  and  a  and  b  are  column  vectors  such  that  [P  a  b]  is  unitary.  It  can  then  be 
verified  that  its  inverse  is 

G-^iz)  =  PP^  -  abt  -I-  2(1  -  ppt)  -  z*abt,  (6.5) 

which  is  anticausal  FIR.  In  the  notation  of  (2.5)  we  have  gm(0)  =  PP^  -f-ab^  and  hnt(O)  =  PP^  -  ab^.  Both 
of  these  matrices  have  rank  Af  —  1  (e.g.,  write  gm(0)  =  (P  a)  [P  b]^  and  apply  Sylvester’s  inequality  [4]) 
so  that  the  annihilating  vectors  u  tmd  v  in  Eq.  (6.1)  are  unique.  In  fact  the  annihilating  vectors  in  (6.1)  are 
u  =  a  and  v  =  b  so  that  u^v  =  0.  Thus  the  condition  uW  =  1  in  (6.1)  cannot  be  satisfied.  Similarly  (6.2) 
cannot  be  satisfied.  So  the  degree  of  (6.4)  cannot  be  reduced  by  extracting  a  degree-one  cafacafi  building 
block. 

The  degree  of  6(2)  is  clearly  >  2  since  the  order  is  seen  to  be  two  from  (6.4).  We  will  show  that  the 
degree  is  exactly  two  by  displaying  an  implementation  with  two  delays.  Since  [  P  a  b  ]  is  unitary,  we  have 
Im  =  aat-|-bbt-»-Ppt.  Using  this  we  can  see  that  the  system  6(2)  in  (6.4)  can  be  implemented  as  in  Fig. 
6.1.  So  the  degree  of  6(2)  is  two  indeed. 

6^.  Degree  reduction  equations  wltit  degree-two  building  blocks 

The  fact  that  we  cannot  factorize  the  2x2  system  (6.3)  into  degree-one  blocks  leads  us  to  ask  if  we  can 
factorize  a  general  2x2  cafacafi  system  using  a  combination  of  degee-one  and  degree-two  building  blocks. 
With  some  algebra  it  can  be  shown  (Appendix  B)  that  the  most  genereJ  2x2  cafacafi  system  with  degree 
equal  to  two,  which  caimot  be  factorized  into  degree  one  cafacafi  systems  has  the  form 

V2(2)  =  UV^  +  2~*I  -I-  52~*UV^,  uW  =  0,  (6.6) 


18 


where  5  is  a  nonzero  scalar.^  By  explicit  multiplication  we  can  verily  that  the  inverse  is  V^^(z)  =  — suvt  + 
zl  -  z*uvt.  Since  V2(z)  is  degree-two  cajacafi,  we  have  jdet  V2(z)]  =  cz“®,  c  /  0. 

Now  let  Gm(z)  be  degree-m  cafacafi  with  (det  Gm(z)]  =  Cm^""*-  Suppose  degree-one  reduction  fails 
(i.e.,  we  cannot  find  u  and  v  satisfying  either  (6.1)  or  (6.2)).  Suppose  we  wish  to  use  (6.6)  to  obtain  a  degree 
reduction  by  two,  i.e.,  we  wish  to  find  a  degree-(m  —  2)  cafacafi  system  such  that 

G„(z)  =  V2(z)G„_j(z).  (6.7) 

Since  (det  V2(z)]  =  cz~*  we  have  (det  G„,_2(z)l  =  It  can  be  shown  (Appendix  C)  that 

Gm-2(2)  will  be  cafacafi  if  and  only  if  u  and  v  are  such  that 

gm(0)  =  uvtg„(l),  h„,(0)  =  -shm(l)uv+  (6.8) 

where  gm(n)  and  hm(n)  are  the  impulse  response  coefficients  of  Gm(z)  and  its  inverse  respectively  (see  Eq. 
(2.5)).  If  the  above  can  be  satisfied  by  choice  of  u  and  v  then  Gm-2(‘2^)  is  cafacafi  with  degree  m  —  2  because 
its  determinant  is  Cm_2Z"<"‘“*i  (Theorem  5.3,  (!]). 

Another  example  of  an  irreducible  cafacafi  system.  Consider  the  2x2  system  G4(z)  =  ab^  -f 
-H  z~^ab^  with  atb  =  0,  which  is  the  same  as  Eq.  (6.3)  with  z  replaced  by  z*.  So  it  is  cafacafi.  We 
still  have  gm(0)  *=  ab^  and  hm(0)  =  — ab^  so  that  degree-one  reduction  is  not  possible  (as  seen  in  Sec.  6.1). 
Since  gm(l)  =  0,  Eq.  (6.8)  cannot  be  satisfied.  Thus  we  cannot  do  degree  reduction  by  two,  if  we  use  the 
building  block  (6.6).  As  the  degree  one  building  block  and  the  degree  two  building  block  we  use  are  the  most 
general  cafacafi  building  blocks,  the  system  G4(z)  cannot  be  factorized  into  lower  degree  cafacafi  blocks  at 
aU. 

FACTORIZATJON  OF  CAUSAL  HR  SYSTEMS  HAVING  FIR  INVERSE 

Let  Gm(2)  be  a  causal  FIR  system,  with  an  FIR  inverse  (not  necessarily  anticausal).  Then  its  determi¬ 
nant  has  the  form  cz~”*,  though  m  does  not  represent  the  McMillan  degree  unless  the  inverse  is  anticausal. 
Unless  Gm(z)  is  unimodular  in  z~^,  we  have  m  >  0,  and  the  determinant  is  zero  for  z  =  oo.  In  other  words, 
the  constant  coefficient  gm(0)  =  Gm(oo)  is  singular. 

Suppose  we  wish  to  express  Gm(2)  in  the  form  Gm{z)  =  Vto(z)Gto-i(2)  where  Vm(z)  is  the  familiar 
cafacafi  building  block  (2.7).  Since  Gm-i(2)  =  VTO(2~^)Gm(*),  it  is  still  FIR.  From  Eq.  (2.8)  we  see  that 
we  can  force  it  to  be  causal  by  choosing  v  such  that  v^gm(O)  =  0.  The  singularity  of  gm(0)  ensures  the 

t  We  can  of  course  multiply  this  with  a  nonsingular  constant  matrix,  but  it  can  be  absorbed  in  Gm-2{z) 
in  (6.7)  and  is  of  no  interest. 
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existence  of  such  nozmuU  v.  The  choice  of  u  is  arbitraiy  except  for  the  requirement  uW  =  1  in  (2.7).  For 
example  we  can  make  u  =  v  with  unit  norm  in  which  case  Vm(2)  becomes  paraunitary. 

Since  (det  Vm(2r)]  =  z~^,  we  have  [det  Gm-i(^)]  =  Thus  Gm_i(2)  is  causal  and  FIR  with 

the  degree  of  determinant  reduced  by  one.  We  can  repeat  this  process  until  we  obtain 

Gm(z)  =  V„,{z)V„_i(z) . . .  Vi(z)Goiz)  (7.1) 

where  Go(2)  is  unimodular  (causal  and  FIR  with  determinant  c  ^  0).  So  we  have  proved: 

Theorem  7.1.  Let  GTO(-r)  he  M  x  M  causal  FIR  with  FIR  inverse  so  that  (det  Gto('J)]  =  cz"*",  c  ^  0. 
Then  we  can  factorize  it  as  in  (7.1)  where  Vm(2)  =  ^1  -  UmVm  +  v|,Um  =  1,  and  Go(z)  is 

unimodular  in  z~^.  The  matrices  Vm(2)  can  be  chosen  to  be  paraunitary  if  desired  (by  taking  =  v,„)  in 
which  case  the  product  of  quantities  on  the  right  hand  side  preceding  Go(z)  is  paraunitary.  0 

As  in  Sec.  4  we  can  also  replace  the  building  blocks  Vt(z)  as  in  (4.6)  to  obtain  a  factorization  of  the 
form  (4.8),  where  To  is  replaced  with  a  unimodular  remainder  Go(2).  If  Vi(z)  are  chosen  to  be  paraunitary, 
then  all  Ti  in  (4.8)  will  be  unitary. 

We  therefore  see  that  any  casual  FIR  system  Gn{z)  with  an  FIR  inverse  can  be  written  as  Gfi(z)  = 
Gc.a(z)Gc,e(2)  where  Gc,a(z)  is  causal  FIR  with  anticausal  FIR  inverse,  and  Gc,c(z)  is  causal  FIR  with 
causal  FIR  inverse.  This  follows  by  letting  Go(z)  =  Gc,c(2)  and  lumping  the  remaining  factors  on  the  right 
side  of  (7.1)  into  Gc, a{z).  In  particular  we  can  let  Gc,a(i:)  be  paraunitary  without  loss  of  generality.  Notice, 
however,  that  the  degree  of  G^C^?)  is  QOt,  in  general,  the  sum  of  the  degrees  of  Gc,a(-K)  SQd  Gc,c(z),  so  this 
is  not  a  minimal  decomposition. 

A  CONCLUDING  REMARKS 

Many  of  the  previously  reported  designs  for  perfect  reconstruction  filter  banks  were  orthonormal  (i.e., 
the  polyphase  matrix  E(z)  was  paraunitaiy).  In  the  HR  case  this  meant  that  if  the  analysis  filters  are  causal 
and  stable  (poles  inside  the  unit  circle)  then  the  synthesis  filters  would  be  anticausal  and  stable  (poles  outside 
the  unit  circle).  In  [1]  we  argued  that  for  the  FIR  case,  the  more  general  class  of  biorthonormal  systems  can 
be  characterized  if  we  can  characterize  all  causal  FIR  polyphase  matrices  with  anticausal  FIR  inverse  (i.e., 
all  cafacafi  matrices).  More  generally,  the  relevance  of  systems  with  anticausal  inverses  was  elaborated  in 
Sec.  1.1  of  {!]. 

The  basic  similarity  between  causal  systems  with  anticausal  inverses  and  causal  paraunitary  systems 
is  fascinating.  First,  the  latter  is  a  special  case  of  the  former.  Second,  the  former  is  characterized  by 
nonsingular  realization  matrices  (for  minimal  realizations)  whereas  the  latter  is  characterized  by  unitary 
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realization  matrices  (up  to  similarity).  Finally  in  the  FIR  case  both  of  these  classes  have  determinant  equal 
to  C2~^  where  N  is  the  McMillan  degree.  (That  is,  both  of  them  achieve  the  maximum  value  that  the 
degree  of  a  detenniant  can  achieve,  viz.,  the  McMillan  degree.)  In  both  cases,  the  most  general  degree-one 
FIR  building  block  has  the  form  —  uvt  +  2“^uvt^Go  where  uW  =  1  and  Go  is  nonsingular.  In  the 
paraunitary  case,  we  further  have  u  =  v  and  Go  is  unitary. 

The  most  significant  difference  between  causal  systems  with  anticausal  inverses  and  causal  paraunitary 
systems  is  that  the  former  cannot  in  general  be  factorized  into  degree  one  building  blocks  whereas  the 
latter  can  be  so  factorized.  This  factorization  was  used  in  the  past  [4]  for  the  design  and  implementation 
of  orthonormal  perfect  reconstruction  filter  banks.  We  saw  in  Sec.  4  above  that  a  special  case  of  cafacafi 
systems  can  indeed  be  factorized  into  degree-one  cafacafi  building  blocks.  These  are  cafacafi  systems  of  order 
one.  This  factorization  gives  rise  to  the  biorthonormal  lapped  transform  (BOLT)  which  is  a  generalization 
of  the  lapped  orthonormal  transform  LOT. 

The  BOLT  is  a  maximally  decimated  analysis  bank  where  the  polyphase  matrix  is  a  first  order  causal 
FIR  s}rstem  with  anticausal  inverse.  Since  it  is  a  generalization  of  the  lapped  oithonormal  transform,  it 
provides  additional  degrees  of  freedom  in  the  design.  It  remains  to  see  how  to  exploit  this  freedom  while 
designing  filter  banks  for  data  compression,  or  for  generation  of  biorthononnal  wavelets  and  so  forth.  These 
require  further  investigation. 

There  are  other  problems  requiring  further  investigation.  In  this  paper  we  introduced  two  cafacafi 
building  blocks,  nemely  the  degree  one  building  block  (2.7)  and  the  degree  two  building  block  (6.6).  (These 
are  the  most  general  building  blocks  we  need  to  consider).  We  showed  that  a  subclass  of  cafacafi  systems, 
namely  the  BOLT  system  can  be  factorized  using  degree-one  building  blocks.  On  the  other  hand  the  degree 
two  building  block  (6.6)  cannot  be  expressed  as  a  product  of  the  degree-one  building  blocks.  Furthermore 
there  exist  examples  of  cafacafi  systems  whose  degree  cannot  be  reduced  using  either  of  these  two  building 
blocks  (end  of  Sec.  6.2).  That  is,  they  cannot  be  expressed  as  a  product  of  any  combination  of  the  two 
building  blocks. 

But  what  does  that  mean?  Perhaps  there  is  a  broader  class  of  building  blocks  which  will  suffice  for 
factorization;  perhaps  the  number  of  required  building  blocks  somehow  depends  on  the  order  and  the  size 
(M  X  M)  of  the  cafacafi  matrices.  This  seems  to  be  an  open  issue  requiring  deeper  investigation. 

In  principle  the  set  of  all  cafacafi  matrices  can  be  characterized  in  terms  of  the  realization  matrix  TZ  (Eq. 
(3.1)).  For  cafacafi  systems,  the  matrix  Tl  is  invertible,  A  has  all  eigenvalues  equal  to  zero  (equivalently  A^’  = 
0  where  A  is  IV  x  N),  and  furthermore  the  matrix  A  in  the  inverse  (3.1)  has  all  eigenvalues  equal  to  zero.  So 
M  X  M  cafacafi  matrices  with  degree  N  are  completely  characterized  by  the  set  of  all  (N  -i-  M)  x  (N  +  M) 
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matrices  71  having  the  following  properties:  (i)  they  are  nonsingular  (ii)  the  top-left  N  x  N  submatrix  A 
has  all  eigenvalues  equal  to  zero,  and  (iii)  the  top-left  N  x  N  submatrix  A  of  7i~^  has  all  eigenvalues  equal 
to  zero.  Finding  a  simple  analytic  way  to  impose  these  three  restrictions  on  a  constant  {N  -t-  M)  x  {N  +  M) 
matrix  Ti  is  still  an  open  problem. 

Af^jendixA.  Degree  of  the  second  on^r  system  (6.3) 

For  arbitrary  M,  the  system  (6.3)  has  degree  M.  To  see  this,  first  consider  U(z)=I  +  2~^abt,  with 
atb  =  0.  This  is  unimodular  (i.e.,  (det  U(z))  =  c  ^  0)  with  U~*(z)  =  I  —  ab^z~^.  Clearly  the  causal  FIR 
system  z“^U(z)  has  the  anticausal  FIR  inverse  zl  —  abt,  and  by  construction  its  determinant  is  cz~^ . 
In  other  words,  z“^U(z)  is  cafacafi  and  its  degree  is  M  (Theorem  5.3,  [1]).  The  system  (6.3),  which  is 
ab^  +  z~^U(z)  therefore  has  degree  M. 

How  do  we  find  a  structure  for  G(z)  with  oidy  M  delays?  Since  a  and  b  are  mutually  orthogonal 
vectors,  we  can  define  a  Af  x  M  unitary  matrix  of  the  form  [P  a  b]  where  P  is  Af  x  (Af  -  2).  (For  this 
purpose  we  assume  that  a  and  b  have  unit  norm  for  simplicity.)  We  then  have  1m  =  aat  bbt  +  PPt, 
so  that  we  can  implement  z~^Im  bs  shown  in  Fig.  A.l(a).  If  we  insert  two  new  branches  as  shown  in  Fig. 
A.l(b),  we  obtain  a  realization  of  (6.3)  with  M  delays.  This,  therefore,  is  a  minimal  realization. 

Appendix  B.  Most  genersl  degree-two  building  block  tor  M=2 

We  now  find  the  most  general  2x2  degree-two  cafacafi  system  G(z)  which  cannot  be  factorized  into 
degree-one  building  blocks.  Since  G(z)  has  degree  =  2,  it  has  the  form 

G(z)  =  g(0)  +  z"*g(l)  +  «"*g(2).  (B.l) 

If  g(2)  =  0,  this  becomes  a  BOLT  and  can  be  factorized  (Sec.  4),  so  we  must  have  g(2)  0.  If  g(0)  =  0, 

then  the  degree-reduction  condition  (2.10)  is  trivially  satisfied  because  we  can  first  choose  u  and  then  let 
V  =  u.  Summarizing,  we  have  g(0)  #  0  and  g(2)  ^  0. 

We  know  that  G”^(z)  has  degree  two  in  z  (end  of  Sec.  5.1,  [1]).  So  it  has  the  form  H(z)  =  h(0)  -I- 
zh(l)-l-z*h(2).  Since  G(z)  cannot  be  factorized  into  degree  one  cafacafi  systems,  we  cannot  factorize  H(z~^) 
into  degree  one  cafacafi  systems.  So  we  can  modify  the  argument  in  the  preceding  paragraph  and  obtain 
h(0)  0  and  h(2)  9^  0.  If  we  now  equate  the  like  powers  of  z  in  G(z)H(z)  =  I  we  obtain,  among  other 

things,  g(0)h(2)  =  0  and  g(2)h(0)  =  0.  Since  none  of  the  matrices  is  null  and  all  of  them  are  2  x  2,  this 
implies  that  they  all  have  rank  one.  So  we  can  write 

G(z)  =  uv^  -f-  z“*g(l)  +  z“^xy^,  (B.2) 
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G~‘(z)  =  H(2)  =  +  2h(l)  +  z*yxxj^,  (B.3) 

for  some  nonzero  vectors  u,v,x,y,ux,  v^.xx  and  yx- 

FVom  Lemma  6.1  we  know  that  in  the  2x2  case,  figure  of  degree-one  reduction  implies  h(0)g(0)  = 
g(0)h(0)  =  0.  So  we  conclude  that  vtvx  =  0  and  u^u  =  0  (hence  the  notation  with  subscript  ±).  Now 
the  condition  G(z)H(z)  =  I  implies,  in  particular,  that  v^yx  =  0  and  yWx  =  0  (since  and  z~^  terms 
in  the  product  are  zero).  Since  all  vectors  are  2  x  1  and  non  null,  we  conclude  yx  =  vx  and  y  =  v  up  to 
scale.  Similarly  from  H(z)G(z)  =  I  we  conclude  that  x  =  u  and  xx  =  Ux  up  to  scale.  Summarizing,  the 
two  matrices  must  have  the  form 

G(2)  =  UV^  +  2~^g(l)  +  2~*SiUV^.  (BA) 

H(2)  =  vxuj^  +  ^Ml)  +  ^^azVxUj.’  (^•®) 

for  non  zero  scalars  si,S3.  Since  v^vx  =  u^ux  =  0,  we  see  that  the  condition  G(z)H(z)  =  I  implies 
g(l)h(l)  =  I.  So  g(l)  and  h(l)  are  non  singular.  We  can  always  factor  them  out,  so  let  us  assiune  g(l)  = 
h(l)  =  I.  That  is,  except  for  a  constant  nonsingular  factor,  we  have  the  form 

G(z)  =  uvt  -I-  z~^l  +  z“*aiuv^.  (5.6) 

H(2)  *  vxu]|^  -f  +  z*«2Vx«x» 

for  non  zero  scalars  Si,S3.  Now  by  equating  the  coefficients  of  z  in  G(z)H(z)  =  I  we  get  uvt  =  — ssvxu^. 
Similarly  vxu^  =  — Siuvt.  This  means,  in  particular,  u  =  vx  up  to  scale,  and  therefore  u^v  =  0.  Siimma- 
rizmg,  the  most  general  2x2  degree-two  cafacafi  system  G(z)  which  cannot  be  factorized  into  degree-one 
building  blocks  has  the  form 

G(z)  =  (uvt  +  +  z-2,iuvt)g(l),  (B.8) 

where  utv  =  0,  g(l)  is  arbitrary  nonsingular,  and  si  is  arbitrary  but  non  zero.  Its  anticarisal  FIR  inverse  is 

H(z)  =  [g(l)]~^  (-siuvt  zl  -  z*uvt^ ,  (R.9) 

as  we  can  double  check  by  multiplying  G(z)  and  H(z). 

Appendix  C.  Degree  two  reduction 

Given  the  cafacafi  s}rstem  Gm{z)  with  inverse  Hnt(z)  as  in  (2.5),  suppose  we  wish  to  perform  a  degree 
reduction  by  two,  using  the  cafacafi  building  block  ^ziz)  in  (6.6).  This  means  that  we  wish  to  find  the 
vectors  u  and  v  such  that  Gm(2)  can  be  expressed  as  in  (6.7)  where  Gm-2(2)  is  cafacafi.  Since  Gm-3(z)  = 
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Vj  ^(«)Gm(^)  it  is  clear  that  it  is  already  FIR,  and  so  is  G“i.2(z)  =  G“^(2)V3(2).  Only  causality  of 
Gm-2(s)  end  anticausality  of  G~!.2(2)  need  to  be  enforced  by  choice  of  u  and  v.  We  have 

Gm-2(«)  =  Vj ‘(^)Gm(a)  =  ^-suvt  +  2I  -  2*uvt^  ^gm(O)  +  Z"‘gm(l)  +  •  •  (C.l) 

Causality  of  this  requires  that  the  coefficients  of  2  and  2^  be  zero,  that  is,  gm(0)  -  uv^gm(l)  =  0,  and 
uvtgm(O)  =  0.  Premultiplying  the  first  of  the  two  conditions  by  vt  and  using  vtu  —  0  we  verify  that  the 
second  requirement  is  automatically  satisfied,  so  it  is  sufficient  to  satisfy  gm(0)  —  uvtg„(l)  =  0.  This  proves 
the  first  part  in  (6.8).  Next 

=  G-‘(2)V2(2)  =  ^hm(O)  +  2h,„(l)  +  . .  +  2-‘l  +  s2-*uvt^ .  (C.2) 

The  anticausality  of  this  requires  that  the  coefficients  of  z~^  and  z~^  be  zero.  Proceeding  as  before,  we 
obtain  the  second  part  in  (6.8). 
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